-- Logs begin at Wed 2022-05-25 13:53:05 UTC, end at Wed 2022-05-25 14:57:35 UTC. -- May 25 14:27:38.416538 dv-cinder-830283-3-smb systemd[1]: Starting Devstack devstack@keystone.service... May 25 14:27:38.425274 dv-cinder-830283-3-smb devstack@keystone.service[80466]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 14:27:38 2022] *** May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: nodename: dv-cinder-830283-3-smb May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: machine: x86_64 May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: clock source: unix May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: pcre jit disabled May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: detected number of CPU cores: 4 May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: current working directory: / May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: detected binary path: /usr/bin/uwsgi-core May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: your processes number limit is 47680 May 25 14:27:38.427310 dv-cinder-830283-3-smb devstack@keystone.service[80466]: your memory page size is 4096 bytes May 25 14:27:38.427909 dv-cinder-830283-3-smb devstack@keystone.service[80466]: detected max file descriptor number: 2048 May 25 14:27:38.427909 dv-cinder-830283-3-smb devstack@keystone.service[80466]: lock engine: pthread robust mutexes May 25 14:27:38.427909 dv-cinder-830283-3-smb devstack@keystone.service[80466]: thunder lock: enabled May 25 14:27:38.427909 dv-cinder-830283-3-smb devstack@keystone.service[80466]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 14:27:38.427909 dv-cinder-830283-3-smb devstack@keystone.service[80466]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 14:27:38.472203 dv-cinder-830283-3-smb devstack@keystone.service[80466]: Python main interpreter initialized at 0x5586ccbac9c0 May 25 14:27:38.472203 dv-cinder-830283-3-smb devstack@keystone.service[80466]: python threads support enabled May 25 14:27:38.472203 dv-cinder-830283-3-smb devstack@keystone.service[80466]: your server socket listen backlog is limited to 100 connections May 25 14:27:38.472203 dv-cinder-830283-3-smb devstack@keystone.service[80466]: your mercy for graceful operations on workers is 90 seconds May 25 14:27:38.472521 dv-cinder-830283-3-smb devstack@keystone.service[80466]: mapped 403077 bytes (393 KB) for 2 cores May 25 14:27:38.472594 dv-cinder-830283-3-smb devstack@keystone.service[80466]: *** Operational MODE: preforking *** May 25 14:27:38.472868 dv-cinder-830283-3-smb devstack@keystone.service[80466]: *** uWSGI is running in multiple interpreter mode *** May 25 14:27:38.472868 dv-cinder-830283-3-smb devstack@keystone.service[80466]: spawned uWSGI master process (pid: 80466) May 25 14:27:38.473058 dv-cinder-830283-3-smb systemd[1]: Started Devstack devstack@keystone.service. May 25 14:27:38.474159 dv-cinder-830283-3-smb devstack@keystone.service[80466]: spawned uWSGI worker 1 (pid: 80475, cores: 1) May 25 14:27:38.474159 dv-cinder-830283-3-smb devstack@keystone.service[80466]: spawned uWSGI worker 2 (pid: 80476, cores: 1) May 25 14:27:38.474159 dv-cinder-830283-3-smb devstack@keystone.service[80466]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 14:27:44.112561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:27:44.112561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: from cryptography.utils import int_from_bytes May 25 14:27:44.113306 dv-cinder-830283-3-smb devstack@keystone.service[80475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:27:44.113306 dv-cinder-830283-3-smb devstack@keystone.service[80475]: from cryptography.utils import int_from_bytes May 25 14:27:44.113956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:27:44.113956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: from cryptography.utils import int_from_bytes May 25 14:27:44.114448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 14:27:44.114448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: from cryptography.utils import int_from_bytes May 25 14:27:44.163835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:27:44.164026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:27:44.164216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] command line args: [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:27:44.164511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:27:44.164707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ================================================================================ {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:27:44.164792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 14:27:44.164936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 14:27:44.165021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] admin_token = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.165129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] command line args: [] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 14:27:44.165214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] config_dir = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.165362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.165450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 14:27:44.165542 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] config_source = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.165626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ================================================================================ {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 14:27:44.165703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] debug = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.165802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] admin_token = **** {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.165907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.166196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] config_dir = [] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.166261 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.166316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.166442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] config_source = [] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.166526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.166597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] debug = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.166707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.166781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.166952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.167123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.167234 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.167336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.167437 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_config_append = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.167532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.167640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.167746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.167849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_dir = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.167849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_file = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.168038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] list_limit = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.168038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] log_config_append = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.168223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.168328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.168430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.168508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] log_dir = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.168508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] log_file = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.168692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.168808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.168895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.169010 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.169086 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.169311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.169391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.169556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.169642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.169787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.169865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.169979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.170109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.170201 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.170356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.170434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.170585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.170682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.170829 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.170917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.171072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.171165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.171343 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.171426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.171583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.171825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.171945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.172019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] publish_errors = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.172133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.172215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.172336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.172420 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.172590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.172821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.79/identity {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.172949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.173025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] publish_errors = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.173139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.173212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.173325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] standard_threads = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.173459 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.173544 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.173621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.173698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.173835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.173920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.174028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] use_journal = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.174136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.174222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] use_json = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.174316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] standard_threads = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.174393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] use_stderr = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.174541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] use_syslog = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.174625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.174965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.175043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.175043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.175173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.175253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] use_journal = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.175324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.175399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] use_json = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.175474 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] use_stderr = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.175548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.175617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] use_syslog = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.175696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.175807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 14:27:44.175927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.176063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.176163 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.176302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.176406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.176563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.176641 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.176801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.176878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.177050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.177129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.177290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.177366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.177540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.177617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.177776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.177854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.178005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.178113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.178276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.178353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.178559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.178637 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.178794 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.178878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.179040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.179123 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.179278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.179355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.179518 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.179599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.179750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.179827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.179986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.180062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.180240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.180316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.180490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.180573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.180734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.180817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.180961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.181036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.181188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.181265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.181423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.181500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.181656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.181733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.181902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.181978 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.182169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.182250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.182398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.182475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.182625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.182701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.182851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.182930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.183096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.183173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.183328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.183404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.183563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.183645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.183790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.183872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.184021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.184106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.184252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.184329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.184477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.184554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.184702 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.184787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.184928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.185006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.185154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.185230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.185393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.185479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.185622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.185697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.185852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.185934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.186092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.186197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.186329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.186406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.186558 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.186634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.186789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.186878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.187029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.187105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.187260 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.187335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.187489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.187564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.187719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.187817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.187951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.188018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.188187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.188308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.188414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.188481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.188650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.188715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.188884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.188966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.189115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.189188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.189348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.189424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.189576 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.189666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.189805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.189878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.190047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.190292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.190372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.190524 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.190638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.190757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.190883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.191020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.191119 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.191253 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.191380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.191495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.191617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.191734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.191850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.191966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.192089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.192197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.192327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.192426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.192598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.192676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.192836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.192928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.193086 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.193164 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.193331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.193409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.193560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.193649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.193793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.193870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.194022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.194117 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.194297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.194378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.194528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.194605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.194784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.194861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.195019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.195098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.195255 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.195334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.195488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.195566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.195722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.195799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.195953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.196029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.196185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.196311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.196448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.196534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.196690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.196768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.196933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.197010 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.197171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.197257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.197411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.197489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.197636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.197714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.197869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.197946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.198139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.198233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.198348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.198426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.198588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.198667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.198821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.198900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.199055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.199133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.199286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.199411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.199526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.199689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.external = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.199766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.199974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.200052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.200228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.200313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.200482 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.200560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.200710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.password = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.200787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.200938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] auth.token = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.201043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.201172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.201263 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] auth.external = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.201404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.201483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.201647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.201725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.201875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.201954 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.202155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] auth.password = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.202234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.202389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] auth.token = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.202470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.202628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.202707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.202862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.202941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.203105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.203183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.203333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.203410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.203581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.203659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.203811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.203889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.204043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.204121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.204271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.204355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] credential.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.204516 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.204593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.204764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.204843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.204994 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.205071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.205233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.205319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.205477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.205556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.205711 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.205790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.205973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.206051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.206234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.206313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.206473 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.206551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.206703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.206780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.206934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.207014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.207174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.207253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.207420 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.207498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.207645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.207724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.207886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.207972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.208116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.208195 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] federation.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.208364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.208444 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.208594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.208672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.208842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.208920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.209073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.209151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.209311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.209395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.209540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.209625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.210326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.210409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.210585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.210673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.210818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.210897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.211048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.211129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.211290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.211368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.211516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.211596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.211749 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.211828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.211994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.212072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.212238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.212436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.212523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.212690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.212788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.212918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.213043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.213236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.213317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.213482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.213560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.213723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.213801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.213971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.214051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.214233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.214314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.214465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.214543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.214700 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.214780 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.214939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.215017 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.215167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.215245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.215397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.215477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.215624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.215702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.215852 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.215938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.216089 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.216169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.216323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.216402 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.216565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.216644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.216791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.216876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.217033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.217111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.217264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.217342 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.217500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.217580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.217741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.217818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.217977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.218054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.218236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.218316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.218472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.218550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.218696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.218773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.218930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.219012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.219162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.219241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.219398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.219476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.219629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.219708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.219862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.219939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.220100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.220178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.220331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.220410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.220556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.220634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.220782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.220860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.221019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.221097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.221257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.221373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.221487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.221565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.221718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.221797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.221946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.222024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.222195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.222286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.222428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.222506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.222677 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.222756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.222902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.222979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.223141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.223221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.223372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.223449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.223606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.223685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.223835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.223913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.224060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.224137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.224290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.224368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.224534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.224613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.224781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.224980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.225057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.225314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.225433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.226143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.226228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.226376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.226455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.226619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.226709 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.226863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.227058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.227137 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.227326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.227413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.227569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.227648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.227803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.227881 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.228035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.228122 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.228267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.228345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.228497 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.228576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.228738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.228825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.228981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.229061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.229214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.229293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.229450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.229536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.229679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.229756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.229911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.229989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.230165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.230257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.230399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.230478 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.230634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.230712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.230873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.230958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.231110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.231188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.231338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.231416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.231570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.231656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.231804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.231882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.232041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.232148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.232278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.232482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.232636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.232716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.232880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.232958 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.233114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.233200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.233349 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.233426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.233589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] resource.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.233667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.233821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.233906 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.234056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.234312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] role.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.234402 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.234556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] role.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.234635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.234782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.234885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.235106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.235185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.235354 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.235433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.235600 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.235680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.235837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.235914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.236078 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.236157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.236316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] role.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.236396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.236566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] role.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.236644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.236797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.236900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.237049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.237187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.237300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.237493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.237572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.237743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.237831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.237988 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.238067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.238257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.238337 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.238520 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.238655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.238767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.238887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.239002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.239134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.239250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.239379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.239499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.239681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.239760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.239928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.240015 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.240160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.240366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.240445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.240602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.240681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.240851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.240956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.241138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.241216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.241369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.241447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.241598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.241678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.241841 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.241919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.242103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.242183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.242356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.242436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.242591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.242669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.242823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.242901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.243048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.243127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.243279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.243358 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.243511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.243590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.243755 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.243835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.243995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.244073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.244230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.244317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.244466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.244545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.244698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.244777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.244934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] token.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.245020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.245170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.245249 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.245412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.245490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.245648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.245735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.245884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.245962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.246134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.246216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.246380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.246471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.246624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.246741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.246859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.246935 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.247081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.247168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.247328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.247406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.247566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.247644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.connection = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.247801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.247889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.248058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.248145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.248300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.248378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.248535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.248612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.248764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.248850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.248997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.249076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.249228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.249307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.connection = **** {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.249460 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.249547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.249700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.249780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.249933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.250012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.250195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.250276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.250427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.250507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.250670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.250749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.250900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.250979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.251133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.251212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.251358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.251435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.251592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.251671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.251814 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.251889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.251960 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:27:44.252053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.252300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.252533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.252777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.253008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.253251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.253482 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 14:27:44.253650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80476) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 14:27:44.284067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.284291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.284513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.284821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.285056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.285283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.293694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.294501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.322385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.322609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.322990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.323239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.376397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.377329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.428287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.428565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.429674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.429913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.494282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.494504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.494724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.494808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.494940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.495024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.495153 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.495237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.495363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.495456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.495645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.495858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.519049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.519277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.519380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.519495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.519579 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.519711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.519794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.519924 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.520016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.520135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.520216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.520341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.520421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.520549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.531679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.532026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.544832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.545052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.545267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.545482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.545694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.545903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.546130 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.546507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.546740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.546962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.547180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.547396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.547607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.547818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80476) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 14:27:44.565369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.565584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:27:44.565684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.565877 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:27:44.565985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.566133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:27:44.566224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.566383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.566473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 14:27:44.566637 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.566741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.566890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.566980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.567140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.567230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.567390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.578074 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.578380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.578545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.578635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.578815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.578908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.579079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.579400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.586999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.587462 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.590284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.590563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.590722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.590841 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.590987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.591120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.591250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.591399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.591522 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.591773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.591855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.592032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.592113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.592300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.592406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.592567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.592656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.592838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.592919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.593101 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.593182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.593427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.620479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.620704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.622223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.622430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.622529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.622705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.627755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.627925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.628008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.628199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.628291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.628474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.635756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.635971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.636060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.636247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.640477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.640672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.640872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.641066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.641162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.641346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.641429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.641625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.641707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.641895 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.641987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.642188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.642276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.642458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.642539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.642723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.660809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.661083 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.661355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.661625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.666248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.666874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.669816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.670125 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.670496 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.670785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.675203 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.675751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.679434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.679880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.683223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.683520 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.683639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.683812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.683928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.684098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.684262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.684382 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.684466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.684657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.684739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.684999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.703477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.703753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.704015 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.704160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.704278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.704361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.704541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.704798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.712274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.712730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.713965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.714268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.714443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.714720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.717292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.717568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.717847 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.718002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.718145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.718303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.718422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.718577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.718846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.732353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.732631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.732788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.732908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.733066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.733183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.733344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.733456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.733633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.733716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.733908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.733999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.734209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.734481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.752800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.754184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.756054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.757926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.759856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.761457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.761696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.763092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.763380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.763722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.764035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.764719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.765001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.765280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.771465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.773184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.773602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.774839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.776843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.777128 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.777407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.777674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.778168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.778458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.778740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.779012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.786689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.786971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.787347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.788071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.788356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.788735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.795186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.795463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.795736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.796004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.796269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.796533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.796622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80476) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 14:27:44.796816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.796917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.797084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.797175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.797354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.797443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.797611 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.797701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.797872 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.797972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.798141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.798222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.798400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.798492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.798652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.798751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.798948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.799214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.799472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.799741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.800005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80476) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 14:27:44.838147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586ccbac9c0 pid: 80475 (default app) May 25 14:27:44.839386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586ccbac9c0 pid: 80476 (default app) May 25 14:27:44.841449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b676-1fc4-4191-b1f3-39c52c97ec7d None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:44.841734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b676-1fc4-4191-b1f3-39c52c97ec7d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:44.842005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0b676-1fc4-4191-b1f3-39c52c97ec7d None None] PATH_INFO: `/v3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:44.846317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 791 bytes} [Wed May 25 14:27:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:52.670187 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0b9a2-899c-4b90-b63a-284adcfddcb6 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.670740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0b9a2-899c-4b90-b63a-284adcfddcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.670740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0b9a2-899c-4b90-b63a-284adcfddcb6 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.675148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1/2] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:27:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:27:52.681073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:52.681493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:52.681616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:52.748814 dv-cinder-830283-3-smb devstack@keystone.service[80475]: INFO dbcounter [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] Registered counter for database keystone May 25 14:27:52.769722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG oslo_db.sqlalchemy.engines [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:27:52.775900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writer thread running {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:27:52.950142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG passlib.handlers.bcrypt [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80475) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 14:27:52.950487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG passlib.handlers.bcrypt [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80475) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 14:27:53.005888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:53.007534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:53.128652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 2/3] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:27:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 25 14:27:53.297731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0b9a2-899c-4b90-b63a-284adcfddcb6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.366423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: INFO dbcounter [None req-cfe0b9a2-899c-4b90-b63a-284adcfddcb6 None None] Registered counter for database keystone May 25 14:27:53.386317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG oslo_db.sqlalchemy.engines [None req-cfe0b9a2-899c-4b90-b63a-284adcfddcb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80476) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 14:27:53.392360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writer thread running {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 14:27:53.509374 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0b9a2-899c-4b90-b63a-284adcfddcb6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.514160 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb44612-7d07-48c4-8cae-6bcbe6be3609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.514812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb44612-7d07-48c4-8cae-6bcbe6be3609 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.515093 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb44612-7d07-48c4-8cae-6bcbe6be3609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.515368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb44612-7d07-48c4-8cae-6bcbe6be3609 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.523343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb44612-7d07-48c4-8cae-6bcbe6be3609 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.574178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ecb44612-7d07-48c4-8cae-6bcbe6be3609 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 14:27:53.574469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb44612-7d07-48c4-8cae-6bcbe6be3609 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:53.583968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1324 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:27:53.589957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:53.604953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388729c0-b149-4b72-b2aa-abee40cf9bef None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:53.609346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e7b62-b10f-4a69-bca8-d8a99ea7cd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:53.610521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7b62-b10f-4a69-bca8-d8a99ea7cd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:53.610811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7b62-b10f-4a69-bca8-d8a99ea7cd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:53.611088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e7b62-b10f-4a69-bca8-d8a99ea7cd50 admin admin] PATH_INFO: `/v3/projects/d9c7281911bf46ffacaa598981eac3c1` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:53.612618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e7b62-b10f-4a69-bca8-d8a99ea7cd50 admin admin] RBAC: Authorizing `identity:get_project(project_id=d9c7281911bf46ffacaa598981eac3c1)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:53.769986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3f6e7b62-b10f-4a69-bca8-d8a99ea7cd50 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 14:27:53.770649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e7b62-b10f-4a69-bca8-d8a99ea7cd50 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:53.775112 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 3/5] 10.222.0.79 () {56 vars in 1207 bytes} [Wed May 25 14:27:53 2022] GET /identity/v3/projects/d9c7281911bf46ffacaa598981eac3c1 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:55.930168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec239d2-4037-4326-a33c-f840d558728f None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:55.930640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec239d2-4037-4326-a33c-f840d558728f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:55.930738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec239d2-4037-4326-a33c-f840d558728f None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:55.934788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 3/6] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:27:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:55.940163 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243824-353f-42b3-87ab-c5a672f06e00 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:55.940569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243824-353f-42b3-87ab-c5a672f06e00 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:55.940730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd243824-353f-42b3-87ab-c5a672f06e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:55.959347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bd243824-353f-42b3-87ab-c5a672f06e00 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:55.960855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bd243824-353f-42b3-87ab-c5a672f06e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:55.968797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:27:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 14:27:55.991590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec239d2-4037-4326-a33c-f840d558728f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.003652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec239d2-4037-4326-a33c-f840d558728f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.007766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e06bc-1b68-4bc7-b410-4284b2a270d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.008388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e06bc-1b68-4bc7-b410-4284b2a270d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.008668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e06bc-1b68-4bc7-b410-4284b2a270d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.008938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e06bc-1b68-4bc7-b410-4284b2a270d8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.016937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e06bc-1b68-4bc7-b410-4284b2a270d8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.018728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e06bc-1b68-4bc7-b410-4284b2a270d8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.027245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1324 bytes} [Wed May 25 14:27:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:27:56.032348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243824-353f-42b3-87ab-c5a672f06e00 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:56.041662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd243824-353f-42b3-87ab-c5a672f06e00 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:56.046026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce61632-5aef-4d87-affc-325519d9d018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:56.047544 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce61632-5aef-4d87-affc-325519d9d018 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:56.047830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce61632-5aef-4d87-affc-325519d9d018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:56.048107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce61632-5aef-4d87-affc-325519d9d018 admin admin] PATH_INFO: `/v3/users/d9d908e34eee4ec195fa8ce65957cba5` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:56.049516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce61632-5aef-4d87-affc-325519d9d018 admin admin] RBAC: Authorizing `identity:get_user(user_id=d9d908e34eee4ec195fa8ce65957cba5)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:56.051374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce61632-5aef-4d87-affc-325519d9d018 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:56.052948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 5/9] 10.222.0.79 () {56 vars in 1198 bytes} [Wed May 25 14:27:56 2022] GET /identity/v3/users/d9d908e34eee4ec195fa8ce65957cba5 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:58.293796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed385c-1265-4a7a-a6b5-093d795ad9d7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.294354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed385c-1265-4a7a-a6b5-093d795ad9d7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.294354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed385c-1265-4a7a-a6b5-093d795ad9d7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.295705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 5/10] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:27:58.300955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85138ef5-a595-45f6-bc61-b031939d3f86 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.301375 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85138ef5-a595-45f6-bc61-b031939d3f86 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.301658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85138ef5-a595-45f6-bc61-b031939d3f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.316275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e02379-da62-40ba-b0ae-31056612110a None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.316565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e02379-da62-40ba-b0ae-31056612110a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.316849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e02379-da62-40ba-b0ae-31056612110a None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.318183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 6/11] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:27:58.318503 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-85138ef5-a595-45f6-bc61-b031939d3f86 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:58.319669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-85138ef5-a595-45f6-bc61-b031939d3f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:58.322972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ac83-46ae-408d-9e1f-be6362893784 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.323268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ac83-46ae-408d-9e1f-be6362893784 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.323555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259ac83-46ae-408d-9e1f-be6362893784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.363215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG passlib.handlers.bcrypt [None req-1259ac83-46ae-408d-9e1f-be6362893784 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80476) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 14:27:58.363637 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG passlib.handlers.bcrypt [None req-1259ac83-46ae-408d-9e1f-be6362893784 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80476) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 14:27:58.399464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:27:58.410110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1259ac83-46ae-408d-9e1f-be6362893784 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:27:58.411723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1259ac83-46ae-408d-9e1f-be6362893784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:27:58.422269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85138ef5-a595-45f6-bc61-b031939d3f86 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.445490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:58.509389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:27:58.524920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85138ef5-a595-45f6-bc61-b031939d3f86 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:58.532054 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259ac83-46ae-408d-9e1f-be6362893784 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.558068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fad08d-ec51-4c56-b7ff-6f4d44ff1017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:58.558825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fad08d-ec51-4c56-b7ff-6f4d44ff1017 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.559112 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fad08d-ec51-4c56-b7ff-6f4d44ff1017 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.559389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fad08d-ec51-4c56-b7ff-6f4d44ff1017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.570711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fad08d-ec51-4c56-b7ff-6f4d44ff1017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f7fad08d-ec51-4c56-b7ff-6f4d44ff1017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:27:58.582193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:58.583359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:27:58.584722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 7/14] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:58.589772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fad08d-ec51-4c56-b7ff-6f4d44ff1017 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.674818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:58.694336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fad08d-ec51-4c56-b7ff-6f4d44ff1017 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:58.729326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daee08-e7f2-44c0-8851-4800ba78a218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:58.729987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daee08-e7f2-44c0-8851-4800ba78a218 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.730298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daee08-e7f2-44c0-8851-4800ba78a218 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.730576 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daee08-e7f2-44c0-8851-4800ba78a218 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.731331 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daee08-e7f2-44c0-8851-4800ba78a218 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:58.731638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daee08-e7f2-44c0-8851-4800ba78a218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:58.733044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23daee08-e7f2-44c0-8851-4800ba78a218 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:58.741308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259ac83-46ae-408d-9e1f-be6362893784 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:58.743666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:58.744531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 8/15] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:58.749896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daee08-e7f2-44c0-8851-4800ba78a218 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.780132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86406cbf-1551-48e9-84d6-34f2ec2f9e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:58.781036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86406cbf-1551-48e9-84d6-34f2ec2f9e71 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.781325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86406cbf-1551-48e9-84d6-34f2ec2f9e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.781595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86406cbf-1551-48e9-84d6-34f2ec2f9e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.850382 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86406cbf-1551-48e9-84d6-34f2ec2f9e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:58.850922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daee08-e7f2-44c0-8851-4800ba78a218 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:58.851853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86406cbf-1551-48e9-84d6-34f2ec2f9e71 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:58.885187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894fbbb-c91a-4b71-8e86-736eed7a62ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:58.886340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894fbbb-c91a-4b71-8e86-736eed7a62ad None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:58.886616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894fbbb-c91a-4b71-8e86-736eed7a62ad None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:58.886885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894fbbb-c91a-4b71-8e86-736eed7a62ad None admin] PATH_INFO: `/v3/users/d9d908e34eee4ec195fa8ce65957cba5` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:58.888072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894fbbb-c91a-4b71-8e86-736eed7a62ad None admin] RBAC: Authorizing `identity:get_user(user_id=d9d908e34eee4ec195fa8ce65957cba5)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:58.889529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894fbbb-c91a-4b71-8e86-736eed7a62ad None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:58.891392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 9/16] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/users/d9d908e34eee4ec195fa8ce65957cba5 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:58.896517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894fbbb-c91a-4b71-8e86-736eed7a62ad None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.910494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:58.949215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 8/17] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:27:58.954689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86406cbf-1551-48e9-84d6-34f2ec2f9e71 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:58.957277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:58.993853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894fbbb-c91a-4b71-8e86-736eed7a62ad None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:59.028591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fff53d-6917-48df-8756-76c45e96295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:59.029380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fff53d-6917-48df-8756-76c45e96295c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.029656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fff53d-6917-48df-8756-76c45e96295c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.029926 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fff53d-6917-48df-8756-76c45e96295c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.031204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fff53d-6917-48df-8756-76c45e96295c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:59.032691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fff53d-6917-48df-8756-76c45e96295c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:59.034348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 10/18] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:27:59.039923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fff53d-6917-48df-8756-76c45e96295c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:59.052020 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86406cbf-1551-48e9-84d6-34f2ec2f9e71 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:59.085023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a945d-bc9e-4ea6-9990-68c232978b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:59.085801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a945d-bc9e-4ea6-9990-68c232978b71 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.086100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a945d-bc9e-4ea6-9990-68c232978b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.086389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a945d-bc9e-4ea6-9990-68c232978b71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.106169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a945d-bc9e-4ea6-9990-68c232978b71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:59.107224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a945d-bc9e-4ea6-9990-68c232978b71 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:59.120095 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-f90a945d-bc9e-4ea6-9990-68c232978b71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:27:59.128235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:27:59.129202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:27:59.130202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:27:59.130202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:27:59.130202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:27:59.130202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:27:59.130202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 9/19] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:27:59.135996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a945d-bc9e-4ea6-9990-68c232978b71 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:27:59.143068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fff53d-6917-48df-8756-76c45e96295c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:59.177168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8136c4a8-7424-4dbc-a32b-79c230c6cda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:59.178597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136c4a8-7424-4dbc-a32b-79c230c6cda7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.178597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136c4a8-7424-4dbc-a32b-79c230c6cda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.178965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8136c4a8-7424-4dbc-a32b-79c230c6cda7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.179796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136c4a8-7424-4dbc-a32b-79c230c6cda7 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.domain.id=default, user.id=d9d908e34eee4ec195fa8ce65957cba5) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:59.180108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136c4a8-7424-4dbc-a32b-79c230c6cda7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:59.181565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8136c4a8-7424-4dbc-a32b-79c230c6cda7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:59.188155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 11/20] 10.222.0.79 () {56 vars in 1322 bytes} [Wed May 25 14:27:59 2022] GET /identity/v3/role_assignments?user.id=d9d908e34eee4ec195fa8ce65957cba5&scope.domain.id=default&role.id=308d9785120a49079e02659953a2b033 => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:27:59.190875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:27:59.237810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a945d-bc9e-4ea6-9990-68c232978b71 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:27:59.274960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4f312-928f-4708-96f8-52202a44ee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:27:59.275640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4f312-928f-4708-96f8-52202a44ee1d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:27:59.275927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4f312-928f-4708-96f8-52202a44ee1d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:27:59.276207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4f312-928f-4708-96f8-52202a44ee1d None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:27:59.276954 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4f312-928f-4708-96f8-52202a44ee1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:27:59.277265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4f312-928f-4708-96f8-52202a44ee1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:27:59.278738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4f312-928f-4708-96f8-52202a44ee1d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:27:59.298843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 10/21] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:01.890748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171d2e0-50dc-492b-86eb-aca1547ed362 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.891279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171d2e0-50dc-492b-86eb-aca1547ed362 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.891279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c171d2e0-50dc-492b-86eb-aca1547ed362 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.892649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 12/22] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:01.898025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e47363-55ba-4811-be87-394ecbc49eb7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.898829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e47363-55ba-4811-be87-394ecbc49eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.899316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e47363-55ba-4811-be87-394ecbc49eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.922313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d0e47363-55ba-4811-be87-394ecbc49eb7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:01.923784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d0e47363-55ba-4811-be87-394ecbc49eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:01.959844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c7b0f-6d15-4c0b-8c7c-2a5faf0891a1 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.960411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c7b0f-6d15-4c0b-8c7c-2a5faf0891a1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.960892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c7b0f-6d15-4c0b-8c7c-2a5faf0891a1 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.962433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 13/23] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:01.971839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668f4de-0694-4d1c-bdd9-28ca6b93b606 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:01.972354 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668f4de-0694-4d1c-bdd9-28ca6b93b606 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:01.972803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f668f4de-0694-4d1c-bdd9-28ca6b93b606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:01.996577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f668f4de-0694-4d1c-bdd9-28ca6b93b606 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:02.003339 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f668f4de-0694-4d1c-bdd9-28ca6b93b606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:02.071106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 11/24] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:02.111703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e47363-55ba-4811-be87-394ecbc49eb7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.159002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 14/25] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:02.191290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668f4de-0694-4d1c-bdd9-28ca6b93b606 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.200979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.315935 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e47363-55ba-4811-be87-394ecbc49eb7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.394185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.402826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321a61-2bf5-4835-ae90-16d57fef2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.403661 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321a61-2bf5-4835-ae90-16d57fef2e4c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.403952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321a61-2bf5-4835-ae90-16d57fef2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.404234 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7321a61-2bf5-4835-ae90-16d57fef2e4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.435027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7321a61-2bf5-4835-ae90-16d57fef2e4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:02.436894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f668f4de-0694-4d1c-bdd9-28ca6b93b606 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-e7321a61-2bf5-4835-ae90-16d57fef2e4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:02.444757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:02.445618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:02.446407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 12/26] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:02.454429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321a61-2bf5-4835-ae90-16d57fef2e4c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.503851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4641d1e-de11-4a38-90af-4dd99daa5ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.504522 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4641d1e-de11-4a38-90af-4dd99daa5ed0 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.504804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4641d1e-de11-4a38-90af-4dd99daa5ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.505518 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4641d1e-de11-4a38-90af-4dd99daa5ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.506845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4641d1e-de11-4a38-90af-4dd99daa5ed0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.508221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4641d1e-de11-4a38-90af-4dd99daa5ed0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.618101 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7321a61-2bf5-4835-ae90-16d57fef2e4c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.625777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.654960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab971-7234-4c22-b4df-c105137ac4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.655725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab971-7234-4c22-b4df-c105137ac4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.656077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab971-7234-4c22-b4df-c105137ac4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.656428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbab971-7234-4c22-b4df-c105137ac4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.657346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab971-7234-4c22-b4df-c105137ac4d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:02.657730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab971-7234-4c22-b4df-c105137ac4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.659217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbab971-7234-4c22-b4df-c105137ac4d6 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.668946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 15/27] 10.222.0.79 () {60 vars in 1131 bytes} [Wed May 25 14:28:02 2022] POST /identity/v3/roles => generated 219 bytes in 478 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:02.670617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad8fb-b750-4444-b20f-d431686cab84 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.670908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad8fb-b750-4444-b20f-d431686cab84 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.671194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ad8fb-b750-4444-b20f-d431686cab84 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.672651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 16/28] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:02.673621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593d716-a95c-49fc-9ad5-2a6cc6868f50 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.673907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593d716-a95c-49fc-9ad5-2a6cc6868f50 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.674273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593d716-a95c-49fc-9ad5-2a6cc6868f50 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.676042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 17/29] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:02.679144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632c38-2918-41f0-b563-fcfe6335f9c0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.679537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632c38-2918-41f0-b563-fcfe6335f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.679907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 13/30] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:02.680120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8632c38-2918-41f0-b563-fcfe6335f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.685722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab971-7234-4c22-b4df-c105137ac4d6 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.700857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a8632c38-2918-41f0-b563-fcfe6335f9c0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:02.702592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a8632c38-2918-41f0-b563-fcfe6335f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:02.790136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 18/31] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:02.792161 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63124c-4cbe-4436-a112-5baa097d5c80 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.792551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63124c-4cbe-4436-a112-5baa097d5c80 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.792928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63124c-4cbe-4436-a112-5baa097d5c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.832927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-da63124c-4cbe-4436-a112-5baa097d5c80 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:02.834208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-da63124c-4cbe-4436-a112-5baa097d5c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:02.917213 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbab971-7234-4c22-b4df-c105137ac4d6 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:02.954689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:02.966387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c653b0-8b2e-4228-953b-226da0286a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:02.967511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c653b0-8b2e-4228-953b-226da0286a8c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:02.967897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c653b0-8b2e-4228-953b-226da0286a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:02.968274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c653b0-8b2e-4228-953b-226da0286a8c None admin] PATH_INFO: `/v3/users/d9d908e34eee4ec195fa8ce65957cba5` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:02.968779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 19/32] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:02.969812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63124c-4cbe-4436-a112-5baa097d5c80 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:02.976322 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c653b0-8b2e-4228-953b-226da0286a8c None admin] RBAC: Authorizing `identity:get_user(user_id=d9d908e34eee4ec195fa8ce65957cba5)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:02.977830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c653b0-8b2e-4228-953b-226da0286a8c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:02.983400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 14/33] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/users/d9d908e34eee4ec195fa8ce65957cba5 => generated 247 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:02.988863 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c653b0-8b2e-4228-953b-226da0286a8c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.035411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.093329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63124c-4cbe-4436-a112-5baa097d5c80 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.111444 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c653b0-8b2e-4228-953b-226da0286a8c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.132070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890056d7-dee8-4d2d-8e1c-1c8bf19e8ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.132750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890056d7-dee8-4d2d-8e1c-1c8bf19e8ca3 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.133034 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890056d7-dee8-4d2d-8e1c-1c8bf19e8ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.133317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890056d7-dee8-4d2d-8e1c-1c8bf19e8ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.134203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890056d7-dee8-4d2d-8e1c-1c8bf19e8ca3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.136004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890056d7-dee8-4d2d-8e1c-1c8bf19e8ca3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.150873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625433-5578-4c55-9385-6b7bb20ca517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.151551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 20/34] 10.222.0.79 () {60 vars in 1131 bytes} [Wed May 25 14:28:02 2022] POST /identity/v3/roles => generated 225 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:03.151801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625433-5578-4c55-9385-6b7bb20ca517 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.152090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625433-5578-4c55-9385-6b7bb20ca517 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.152410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db625433-5578-4c55-9385-6b7bb20ca517 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.152573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890056d7-dee8-4d2d-8e1c-1c8bf19e8ca3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.153870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db625433-5578-4c55-9385-6b7bb20ca517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.155673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db625433-5578-4c55-9385-6b7bb20ca517 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.158198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 15/35] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:03.164817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625433-5578-4c55-9385-6b7bb20ca517 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.218428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.271224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890056d7-dee8-4d2d-8e1c-1c8bf19e8ca3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.286506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db625433-5578-4c55-9385-6b7bb20ca517 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.290117 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.316346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94694c6f-bc73-47f2-b25b-bef510ad6ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.317228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94694c6f-bc73-47f2-b25b-bef510ad6ebd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.317518 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94694c6f-bc73-47f2-b25b-bef510ad6ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.317796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94694c6f-bc73-47f2-b25b-bef510ad6ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.328023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3247370-0073-4984-9f11-f3ab5a656998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.328905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3247370-0073-4984-9f11-f3ab5a656998 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.329189 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3247370-0073-4984-9f11-f3ab5a656998 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.329469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3247370-0073-4984-9f11-f3ab5a656998 None admin] PATH_INFO: `/v3/domains/default/users/d9d908e34eee4ec195fa8ce65957cba5/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.330194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94694c6f-bc73-47f2-b25b-bef510ad6ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.331617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3247370-0073-4984-9f11-f3ab5a656998 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d9d908e34eee4ec195fa8ce65957cba5, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.331824 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94694c6f-bc73-47f2-b25b-bef510ad6ebd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.333070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3247370-0073-4984-9f11-f3ab5a656998 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-94694c6f-bc73-47f2-b25b-bef510ad6ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:28:03.355673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:03.357961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:03.359806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:28:03.359806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:28:03.359806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:28:03.359806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:03.359806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 21/36] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:03.363388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94694c6f-bc73-47f2-b25b-bef510ad6ebd None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.481587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 16/37] 10.222.0.79 () {58 vars in 1361 bytes} [Wed May 25 14:28:03 2022] PUT /identity/v3/domains/default/users/d9d908e34eee4ec195fa8ce65957cba5/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:03.494898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7271f-4ab5-4363-890a-13c8c9a755c9 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.495212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7271f-4ab5-4363-890a-13c8c9a755c9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.495469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7271f-4ab5-4363-890a-13c8c9a755c9 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.501364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 17/38] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:03.507521 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d64ca3-c60f-436c-8abe-e08b2bde8366 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.507803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d64ca3-c60f-436c-8abe-e08b2bde8366 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.508113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d64ca3-c60f-436c-8abe-e08b2bde8366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.534071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-b6d64ca3-c60f-436c-8abe-e08b2bde8366 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:03.535678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b6d64ca3-c60f-436c-8abe-e08b2bde8366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:03.583129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94694c6f-bc73-47f2-b25b-bef510ad6ebd None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.594664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.625775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 18/39] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:03.644892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63228c0b-25bd-4129-b2e4-bcd01800f5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.647179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63228c0b-25bd-4129-b2e4-bcd01800f5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.647380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347a31-cbe5-47f8-bd1a-88201360bdc3 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.647671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347a31-cbe5-47f8-bd1a-88201360bdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.647948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba347a31-cbe5-47f8-bd1a-88201360bdc3 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.648261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63228c0b-25bd-4129-b2e4-bcd01800f5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.648777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63228c0b-25bd-4129-b2e4-bcd01800f5c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.649342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 19/40] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:03.649901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63228c0b-25bd-4129-b2e4-bcd01800f5c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:03.650440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63228c0b-25bd-4129-b2e4-bcd01800f5c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.651604 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347a31-cbe5-47f8-bd1a-88201360bdc3 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.652025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63228c0b-25bd-4129-b2e4-bcd01800f5c1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.674499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 22/41] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:03.676228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2e70d-874a-4004-afb2-e9c92aa6ec20 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.676751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2e70d-874a-4004-afb2-e9c92aa6ec20 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.677393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2e70d-874a-4004-afb2-e9c92aa6ec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.698821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f6e2e70d-874a-4004-afb2-e9c92aa6ec20 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:03.700419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f6e2e70d-874a-4004-afb2-e9c92aa6ec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:03.768980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.775490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 23/42] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:03.776664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2e70d-874a-4004-afb2-e9c92aa6ec20 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.782943 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba347a31-cbe5-47f8-bd1a-88201360bdc3 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.823874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e37ae-fbc4-4f4b-8c2d-2064b5d6ae51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.824689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e37ae-fbc4-4f4b-8c2d-2064b5d6ae51 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.824979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e37ae-fbc4-4f4b-8c2d-2064b5d6ae51 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.825259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e37ae-fbc4-4f4b-8c2d-2064b5d6ae51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.826501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e37ae-fbc4-4f4b-8c2d-2064b5d6ae51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.828113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e37ae-fbc4-4f4b-8c2d-2064b5d6ae51 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.829749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 20/43] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:03.830525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e37ae-fbc4-4f4b-8c2d-2064b5d6ae51 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.895415 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:03.902579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2e70d-874a-4004-afb2-e9c92aa6ec20 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.939368 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b838d-a237-4496-a56b-6685b9d08e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.939947 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b838d-a237-4496-a56b-6685b9d08e67 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.940235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b838d-a237-4496-a56b-6685b9d08e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.940761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b838d-a237-4496-a56b-6685b9d08e67 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.941217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b838d-a237-4496-a56b-6685b9d08e67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.942743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b838d-a237-4496-a56b-6685b9d08e67 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:03.943783 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e37ae-fbc4-4f4b-8c2d-2064b5d6ae51 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:03.971797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 24/44] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:28:03 2022] POST /identity/v3/projects => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:03.972421 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b838d-a237-4496-a56b-6685b9d08e67 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:03.989729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5979c7b-ad02-45ca-a8fc-fe8496e81a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:03.991620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979c7b-ad02-45ca-a8fc-fe8496e81a15 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:03.992851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979c7b-ad02-45ca-a8fc-fe8496e81a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:03.993639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979c7b-ad02-45ca-a8fc-fe8496e81a15 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:03.994667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5979c7b-ad02-45ca-a8fc-fe8496e81a15 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:03.997118 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5979c7b-ad02-45ca-a8fc-fe8496e81a15 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:04.017894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 21/45] 10.222.0.79 () {60 vars in 1131 bytes} [Wed May 25 14:28:03 2022] POST /identity/v3/roles => generated 223 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:04.109460 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b838d-a237-4496-a56b-6685b9d08e67 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:04.152863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d2ebd-ddb4-4e00-be85-24888d65409e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:04.153808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d2ebd-ddb4-4e00-be85-24888d65409e None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:04.154309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d2ebd-ddb4-4e00-be85-24888d65409e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:04.154726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d2ebd-ddb4-4e00-be85-24888d65409e None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:04.155604 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d2ebd-ddb4-4e00-be85-24888d65409e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:04.157326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d2ebd-ddb4-4e00-be85-24888d65409e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:04.190654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:04.199087 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 25/46] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:28:03 2022] POST /identity/v3/projects => generated 312 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:05.763286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed6ec-41d6-470d-b0db-603f9234a32b None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:05.763793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed6ec-41d6-470d-b0db-603f9234a32b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:05.763873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ed6ec-41d6-470d-b0db-603f9234a32b None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:05.765227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 22/47] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:05.770469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26079121-668f-49c5-8b8d-3ee0aa960c22 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:05.770833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26079121-668f-49c5-8b8d-3ee0aa960c22 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:05.771148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26079121-668f-49c5-8b8d-3ee0aa960c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:05.788059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-26079121-668f-49c5-8b8d-3ee0aa960c22 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:05.789236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-26079121-668f-49c5-8b8d-3ee0aa960c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:05.857285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 26/48] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:05.879765 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ed6ec-41d6-470d-b0db-603f9234a32b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:05.904829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:05.983802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ed6ec-41d6-470d-b0db-603f9234a32b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.015825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6ff43-4b76-4c62-ac79-cafeb63e3a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.016550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ff43-4b76-4c62-ac79-cafeb63e3a32 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.016833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ff43-4b76-4c62-ac79-cafeb63e3a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.017105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6ff43-4b76-4c62-ac79-cafeb63e3a32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.027419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6ff43-4b76-4c62-ac79-cafeb63e3a32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-fea6ff43-4b76-4c62-ac79-cafeb63e3a32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:06.035105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:06.036079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:06.036956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 23/49] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:28:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:06.042547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26079121-668f-49c5-8b8d-3ee0aa960c22 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.145916 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26079121-668f-49c5-8b8d-3ee0aa960c22 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.183705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.190185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e1cdb-780a-4ba4-8854-b7948c8aa198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.190871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e1cdb-780a-4ba4-8854-b7948c8aa198 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.191152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e1cdb-780a-4ba4-8854-b7948c8aa198 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.191428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e1cdb-780a-4ba4-8854-b7948c8aa198 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.192202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e1cdb-780a-4ba4-8854-b7948c8aa198 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:06.192510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e1cdb-780a-4ba4-8854-b7948c8aa198 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.194529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e1cdb-780a-4ba4-8854-b7948c8aa198 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.210779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 27/50] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:06.212045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6ff43-4b76-4c62-ac79-cafeb63e3a32 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.293865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.312011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6ff43-4b76-4c62-ac79-cafeb63e3a32 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.345376 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02608fe7-e340-4b88-aeba-db32b805e70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.346293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608fe7-e340-4b88-aeba-db32b805e70a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.346584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608fe7-e340-4b88-aeba-db32b805e70a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.346865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02608fe7-e340-4b88-aeba-db32b805e70a None admin] PATH_INFO: `/v3/users/d9d908e34eee4ec195fa8ce65957cba5` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.348055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608fe7-e340-4b88-aeba-db32b805e70a None admin] RBAC: Authorizing `identity:get_user(user_id=d9d908e34eee4ec195fa8ce65957cba5)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.349565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02608fe7-e340-4b88-aeba-db32b805e70a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.351224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 24/51] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:06 2022] GET /identity/v3/users/d9d908e34eee4ec195fa8ce65957cba5 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:06.356528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e1cdb-780a-4ba4-8854-b7948c8aa198 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.388208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5ca85-2377-4e09-916e-3266050743d6 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.388497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5ca85-2377-4e09-916e-3266050743d6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.388779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5ca85-2377-4e09-916e-3266050743d6 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.390140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 25/52] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:06.394933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f066-498e-4642-93c2-bd485608e97c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.395222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f066-498e-4642-93c2-bd485608e97c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.395503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c9f066-498e-4642-93c2-bd485608e97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.411974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-41c9f066-498e-4642-93c2-bd485608e97c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:06.413167 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-41c9f066-498e-4642-93c2-bd485608e97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:06.455068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e1cdb-780a-4ba4-8854-b7948c8aa198 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.478887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 26/53] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:06.488355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468109e-fc14-491d-b83b-2e5a784cd2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.489147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468109e-fc14-491d-b83b-2e5a784cd2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.489431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468109e-fc14-491d-b83b-2e5a784cd2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.489703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468109e-fc14-491d-b83b-2e5a784cd2a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.490961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468109e-fc14-491d-b83b-2e5a784cd2a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.492427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468109e-fc14-491d-b83b-2e5a784cd2a1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.494040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 28/54] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:06.499587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9f066-498e-4642-93c2-bd485608e97c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.501173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468109e-fc14-491d-b83b-2e5a784cd2a1 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.558423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.579800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.602548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c9f066-498e-4642-93c2-bd485608e97c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.602703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468109e-fc14-491d-b83b-2e5a784cd2a1 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.635970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb761b9-c094-43a1-bfdf-1decddd64490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.636211 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88cfe54-1eff-4d87-a4eb-5eee4c523601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.636760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb761b9-c094-43a1-bfdf-1decddd64490 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.636863 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cfe54-1eff-4d87-a4eb-5eee4c523601 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.637041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb761b9-c094-43a1-bfdf-1decddd64490 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.637148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cfe54-1eff-4d87-a4eb-5eee4c523601 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.637313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb761b9-c094-43a1-bfdf-1decddd64490 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.637407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cfe54-1eff-4d87-a4eb-5eee4c523601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.638267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88cfe54-1eff-4d87-a4eb-5eee4c523601 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.domain.id=default, user.id=d9d908e34eee4ec195fa8ce65957cba5) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:06.638527 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb761b9-c094-43a1-bfdf-1decddd64490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.638624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88cfe54-1eff-4d87-a4eb-5eee4c523601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.639994 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb761b9-c094-43a1-bfdf-1decddd64490 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.640103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88cfe54-1eff-4d87-a4eb-5eee4c523601 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.641602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 29/55] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:06.647583 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb761b9-c094-43a1-bfdf-1decddd64490 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:06.648718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 27/56] 10.222.0.79 () {56 vars in 1322 bytes} [Wed May 25 14:28:06 2022] GET /identity/v3/role_assignments?user.id=d9d908e34eee4ec195fa8ce65957cba5&scope.domain.id=default&role.id=308d9785120a49079e02659953a2b033 => generated 530 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:06.750844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb761b9-c094-43a1-bfdf-1decddd64490 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:06.777851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:06.786334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d710d-fbfa-408d-8127-a9720dbdf047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:06.787577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d710d-fbfa-408d-8127-a9720dbdf047 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:06.787871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d710d-fbfa-408d-8127-a9720dbdf047 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:06.788154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d710d-fbfa-408d-8127-a9720dbdf047 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:06.788876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d710d-fbfa-408d-8127-a9720dbdf047 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:06.790378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d710d-fbfa-408d-8127-a9720dbdf047 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:06.816751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 30/57] 10.222.0.79 () {60 vars in 1140 bytes} [Wed May 25 14:28:06 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:28:08.993853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bece68-b712-4287-9e9e-3a1f07d8ade7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:08.994407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bece68-b712-4287-9e9e-3a1f07d8ade7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:08.994881 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bece68-b712-4287-9e9e-3a1f07d8ade7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:08.996659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 28/58] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:09.002031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9283f-153e-463f-a8c9-a0619d20c8aa None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.002432 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9283f-153e-463f-a8c9-a0619d20c8aa None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.002638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f9283f-153e-463f-a8c9-a0619d20c8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.019370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e3f9283f-153e-463f-a8c9-a0619d20c8aa None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:09.020550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e3f9283f-153e-463f-a8c9-a0619d20c8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:09.084960 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 31/59] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:09.109525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bece68-b712-4287-9e9e-3a1f07d8ade7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.222295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bece68-b712-4287-9e9e-3a1f07d8ade7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.253834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2576d0f0-3aad-4542-9505-c43a0944211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.254645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d0f0-3aad-4542-9505-c43a0944211b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.254931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d0f0-3aad-4542-9505-c43a0944211b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.255205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2576d0f0-3aad-4542-9505-c43a0944211b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.256901 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576d0f0-3aad-4542-9505-c43a0944211b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.258393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2576d0f0-3aad-4542-9505-c43a0944211b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.259998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 29/60] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:09.265721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9283f-153e-463f-a8c9-a0619d20c8aa None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:09.360037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f9283f-153e-463f-a8c9-a0619d20c8aa None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:09.370001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:09.394283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dee4b2-e521-4f9f-840a-61b3a662ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:09.394947 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee4b2-e521-4f9f-840a-61b3a662ad7a None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:09.395232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee4b2-e521-4f9f-840a-61b3a662ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:09.395507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dee4b2-e521-4f9f-840a-61b3a662ad7a None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:09.396254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dee4b2-e521-4f9f-840a-61b3a662ad7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:09.398262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dee4b2-e521-4f9f-840a-61b3a662ad7a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:09.422232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 32/61] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:28:09 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:12.578239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1654ff-e2c2-43a0-818c-533759e943b7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.579247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1654ff-e2c2-43a0-818c-533759e943b7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.579761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1654ff-e2c2-43a0-818c-533759e943b7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.581576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 30/62] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:12.593500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b2ba-685b-4407-8955-d4be6cb793de None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.594350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b2ba-685b-4407-8955-d4be6cb793de None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.594777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2097b2ba-685b-4407-8955-d4be6cb793de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.622645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2097b2ba-685b-4407-8955-d4be6cb793de None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:12.624174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2097b2ba-685b-4407-8955-d4be6cb793de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:12.723673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 33/63] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:12.759320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1654ff-e2c2-43a0-818c-533759e943b7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:12.780729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:12.875477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308229c-ebc7-4047-b1da-8ec57a25c837 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.875772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308229c-ebc7-4047-b1da-8ec57a25c837 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.876541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308229c-ebc7-4047-b1da-8ec57a25c837 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.878292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 34/64] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:12.883536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422b31-85be-4fac-9f52-d1fbc01bba77 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.884126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422b31-85be-4fac-9f52-d1fbc01bba77 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.884609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e422b31-85be-4fac-9f52-d1fbc01bba77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.913433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1654ff-e2c2-43a0-818c-533759e943b7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:12.915867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6e422b31-85be-4fac-9f52-d1fbc01bba77 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:12.917066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6e422b31-85be-4fac-9f52-d1fbc01bba77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:12.966716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c37d3c-2c06-4917-8b44-4985c340e37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:12.967544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c37d3c-2c06-4917-8b44-4985c340e37c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:12.967935 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c37d3c-2c06-4917-8b44-4985c340e37c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:12.968267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c37d3c-2c06-4917-8b44-4985c340e37c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:12.989203 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c37d3c-2c06-4917-8b44-4985c340e37c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-19c37d3c-2c06-4917-8b44-4985c340e37c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:12.999447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:13.000336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:13.001514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 31/65] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:13.008157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 35/66] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:13.009106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c37d3c-2c06-4917-8b44-4985c340e37c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.031440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422b31-85be-4fac-9f52-d1fbc01bba77 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.078179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.176978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e422b31-85be-4fac-9f52-d1fbc01bba77 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.187171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.212366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e9308-34f3-4fa1-828c-59438035a48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.213445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9308-34f3-4fa1-828c-59438035a48c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.213875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9308-34f3-4fa1-828c-59438035a48c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.214411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e9308-34f3-4fa1-828c-59438035a48c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.230821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e9308-34f3-4fa1-828c-59438035a48c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:13.233666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c37d3c-2c06-4917-8b44-4985c340e37c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e99e9308-34f3-4fa1-828c-59438035a48c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:13.240942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:13.241983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:13.242790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:13.243490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 36/67] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:13.249113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969268c0-bcb0-43ac-b4fa-d3798925848d None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.249113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969268c0-bcb0-43ac-b4fa-d3798925848d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.249113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969268c0-bcb0-43ac-b4fa-d3798925848d None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.249113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 37/68] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:13.249627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969268c0-bcb0-43ac-b4fa-d3798925848d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.281804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b31a1-f91d-4fe7-a246-57750be32199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.282691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b31a1-f91d-4fe7-a246-57750be32199 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.283043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b31a1-f91d-4fe7-a246-57750be32199 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.283336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b31a1-f91d-4fe7-a246-57750be32199 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.284130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b31a1-f91d-4fe7-a246-57750be32199 None admin] RBAC: Adding query filter params (name=member) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:13.284446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b31a1-f91d-4fe7-a246-57750be32199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.285925 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b31a1-f91d-4fe7-a246-57750be32199 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.296038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 32/69] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:13.297400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c991419-50e5-464c-b9bd-b99e0cf5d193 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.297697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c991419-50e5-464c-b9bd-b99e0cf5d193 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.297980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c991419-50e5-464c-b9bd-b99e0cf5d193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.315527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-0c991419-50e5-464c-b9bd-b99e0cf5d193 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:13.316715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0c991419-50e5-464c-b9bd-b99e0cf5d193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:13.357065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.379876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969268c0-bcb0-43ac-b4fa-d3798925848d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.390430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 33/70] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:13.391951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889c698-f2bb-40d9-849b-73bb8138f16e None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.392250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889c698-f2bb-40d9-849b-73bb8138f16e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.392532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889c698-f2bb-40d9-849b-73bb8138f16e None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.393954 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 34/71] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:13.394525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889c698-f2bb-40d9-849b-73bb8138f16e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.427866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60df9af7-58c4-417a-aa66-36af2eda9f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.428465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df9af7-58c4-417a-aa66-36af2eda9f6e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.428752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df9af7-58c4-417a-aa66-36af2eda9f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.429029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df9af7-58c4-417a-aa66-36af2eda9f6e None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.429945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df9af7-58c4-417a-aa66-36af2eda9f6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:13.430434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df9af7-58c4-417a-aa66-36af2eda9f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.431850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60df9af7-58c4-417a-aa66-36af2eda9f6e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.441431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 38/72] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:13.442671 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884abf7a-9403-4d67-842e-ad11f04c808a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.443141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884abf7a-9403-4d67-842e-ad11f04c808a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.443561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884abf7a-9403-4d67-842e-ad11f04c808a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.460122 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-884abf7a-9403-4d67-842e-ad11f04c808a None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:13.461303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-884abf7a-9403-4d67-842e-ad11f04c808a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:13.468009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.507141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889c698-f2bb-40d9-849b-73bb8138f16e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.528958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 39/73] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:13.529794 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884abf7a-9403-4d67-842e-ad11f04c808a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.549334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba570d-be01-4feb-b9a8-094899a894c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.550351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba570d-be01-4feb-b9a8-094899a894c8 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.550662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba570d-be01-4feb-b9a8-094899a894c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.551010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba570d-be01-4feb-b9a8-094899a894c8 None admin] PATH_INFO: `/v3/users/34ed119cc247421babe93929a9f89aa8` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.567209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba570d-be01-4feb-b9a8-094899a894c8 None admin] RBAC: Authorizing `identity:get_user(user_id=34ed119cc247421babe93929a9f89aa8)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.568700 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba570d-be01-4feb-b9a8-094899a894c8 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.570434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 35/74] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/users/34ed119cc247421babe93929a9f89aa8 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:13.571188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba570d-be01-4feb-b9a8-094899a894c8 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.612996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.634017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884abf7a-9403-4d67-842e-ad11f04c808a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.668378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba570d-be01-4feb-b9a8-094899a894c8 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.669728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea7c2f-6b6f-4bbe-8105-da3323549a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.670561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea7c2f-6b6f-4bbe-8105-da3323549a6f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.670848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea7c2f-6b6f-4bbe-8105-da3323549a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.671127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea7c2f-6b6f-4bbe-8105-da3323549a6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.681272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eea7c2f-6b6f-4bbe-8105-da3323549a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-4eea7c2f-6b6f-4bbe-8105-da3323549a6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:13.689011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:13.689864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:13.690634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:13.691183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.692184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 40/75] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:13.694303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba3a61-fae4-4b48-86f8-a7ac2602a564 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.694595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba3a61-fae4-4b48-86f8-a7ac2602a564 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.694881 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cba3a61-fae4-4b48-86f8-a7ac2602a564 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.696466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 41/76] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:13.697168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba3a61-fae4-4b48-86f8-a7ac2602a564 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.704148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d03b81-a634-4047-aa69-2d65a64da437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.705037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d03b81-a634-4047-aa69-2d65a64da437 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.705320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d03b81-a634-4047-aa69-2d65a64da437 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.705598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d03b81-a634-4047-aa69-2d65a64da437 None admin] PATH_INFO: `/v3/users/d9d908e34eee4ec195fa8ce65957cba5` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.706802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d03b81-a634-4047-aa69-2d65a64da437 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d908e34eee4ec195fa8ce65957cba5)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.708263 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d03b81-a634-4047-aa69-2d65a64da437 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.710506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 36/77] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/users/d9d908e34eee4ec195fa8ce65957cba5 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:13.711265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d03b81-a634-4047-aa69-2d65a64da437 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.801478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cba3a61-fae4-4b48-86f8-a7ac2602a564 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.809372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d03b81-a634-4047-aa69-2d65a64da437 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.834560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f084d8-232a-4b67-83b4-994c4f33311c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.835364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f084d8-232a-4b67-83b4-994c4f33311c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.835652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f084d8-232a-4b67-83b4-994c4f33311c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.835929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f084d8-232a-4b67-83b4-994c4f33311c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.842906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.843019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4238e9-6cda-4f39-8412-5a578c116e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.843788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4238e9-6cda-4f39-8412-5a578c116e61 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.843888 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4238e9-6cda-4f39-8412-5a578c116e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.844142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4238e9-6cda-4f39-8412-5a578c116e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.849183 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f084d8-232a-4b67-83b4-994c4f33311c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-45f084d8-232a-4b67-83b4-994c4f33311c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:13.857781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:13.858897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:13.859744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 42/78] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:13.861516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f084d8-232a-4b67-83b4-994c4f33311c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:13.903293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:13.913938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4238e9-6cda-4f39-8412-5a578c116e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.915458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4238e9-6cda-4f39-8412-5a578c116e61 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:13.959012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f084d8-232a-4b67-83b4-994c4f33311c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:13.992810 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03651f69-50a7-496e-8d46-23afc52459dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:13.993465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03651f69-50a7-496e-8d46-23afc52459dc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:13.993750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03651f69-50a7-496e-8d46-23afc52459dc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:13.994026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03651f69-50a7-496e-8d46-23afc52459dc None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:13.994807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03651f69-50a7-496e-8d46-23afc52459dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:13.995117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03651f69-50a7-496e-8d46-23afc52459dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:13.996524 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03651f69-50a7-496e-8d46-23afc52459dc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.004445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 43/79] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:14.005648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fcf8-2388-4cc1-b677-24b8ddff7c94 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.005995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fcf8-2388-4cc1-b677-24b8ddff7c94 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.006307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2fcf8-2388-4cc1-b677-24b8ddff7c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.014598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 37/80] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:14.015430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4238e9-6cda-4f39-8412-5a578c116e61 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.024274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9dd2fcf8-2388-4cc1-b677-24b8ddff7c94 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:14.025468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9dd2fcf8-2388-4cc1-b677-24b8ddff7c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:14.079775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.095115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 44/81] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:14.095914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2fcf8-2388-4cc1-b677-24b8ddff7c94 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.117857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.128507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4238e9-6cda-4f39-8412-5a578c116e61 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.163532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f323afb-970d-4dfd-b2ca-97f47840ff0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.164182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f323afb-970d-4dfd-b2ca-97f47840ff0a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.164470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f323afb-970d-4dfd-b2ca-97f47840ff0a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.164746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f323afb-970d-4dfd-b2ca-97f47840ff0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.195157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2fcf8-2388-4cc1-b677-24b8ddff7c94 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.230427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f323afb-970d-4dfd-b2ca-97f47840ff0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.231853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f323afb-970d-4dfd-b2ca-97f47840ff0a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.234430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afeed9-b55c-40a7-8833-38b91a565b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.235103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afeed9-b55c-40a7-8833-38b91a565b65 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.235390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afeed9-b55c-40a7-8833-38b91a565b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.235673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afeed9-b55c-40a7-8833-38b91a565b65 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.236422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afeed9-b55c-40a7-8833-38b91a565b65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:14.236728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afeed9-b55c-40a7-8833-38b91a565b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.238120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0afeed9-b55c-40a7-8833-38b91a565b65 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.245936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 45/82] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:14.246747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afeed9-b55c-40a7-8833-38b91a565b65 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.297118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.323014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.334558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 38/83] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:14.335364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f323afb-970d-4dfd-b2ca-97f47840ff0a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.347638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afeed9-b55c-40a7-8833-38b91a565b65 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.380454 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff4bb0-fc81-424c-b2f4-8c8e99562179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.381325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4bb0-fc81-424c-b2f4-8c8e99562179 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.381606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4bb0-fc81-424c-b2f4-8c8e99562179 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.381879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ff4bb0-fc81-424c-b2f4-8c8e99562179 None admin] PATH_INFO: `/v3/users/34ed119cc247421babe93929a9f89aa8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.383107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff4bb0-fc81-424c-b2f4-8c8e99562179 None admin] RBAC: Authorizing `identity:get_user(user_id=34ed119cc247421babe93929a9f89aa8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.384573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ff4bb0-fc81-424c-b2f4-8c8e99562179 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.386481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 46/84] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/users/34ed119cc247421babe93929a9f89aa8 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:14.387231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff4bb0-fc81-424c-b2f4-8c8e99562179 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.437743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f323afb-970d-4dfd-b2ca-97f47840ff0a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.472123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7c350-3e0a-405c-b2fa-08e2b927c9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.472989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c350-3e0a-405c-b2fa-08e2b927c9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.473277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c350-3e0a-405c-b2fa-08e2b927c9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.473553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c350-3e0a-405c-b2fa-08e2b927c9b4 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.474850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7c350-3e0a-405c-b2fa-08e2b927c9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.476391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7c350-3e0a-405c-b2fa-08e2b927c9b4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.478138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 39/85] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:14.478908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7c350-3e0a-405c-b2fa-08e2b927c9b4 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.485224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ff4bb0-fc81-424c-b2f4-8c8e99562179 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.504146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.519621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3adc62-68d3-4b0c-a2fc-ad0ada9bf4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.520419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3adc62-68d3-4b0c-a2fc-ad0ada9bf4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.520709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3adc62-68d3-4b0c-a2fc-ad0ada9bf4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.521013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3adc62-68d3-4b0c-a2fc-ad0ada9bf4d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.522706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3adc62-68d3-4b0c-a2fc-ad0ada9bf4d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.524176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3adc62-68d3-4b0c-a2fc-ad0ada9bf4d9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.525789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 47/86] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:14.526580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3adc62-68d3-4b0c-a2fc-ad0ada9bf4d9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.538021 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.578790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7c350-3e0a-405c-b2fa-08e2b927c9b4 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.612309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321dac6-7125-407b-8722-0b71ec90c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.613179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321dac6-7125-407b-8722-0b71ec90c3ab None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.613461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321dac6-7125-407b-8722-0b71ec90c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.613734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9321dac6-7125-407b-8722-0b71ec90c3ab None admin] PATH_INFO: `/v3/users/34ed119cc247421babe93929a9f89aa8` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.615000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321dac6-7125-407b-8722-0b71ec90c3ab None admin] RBAC: Authorizing `identity:get_user(user_id=34ed119cc247421babe93929a9f89aa8)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.616436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9321dac6-7125-407b-8722-0b71ec90c3ab None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.618041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 40/87] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/users/34ed119cc247421babe93929a9f89aa8 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:14.618821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321dac6-7125-407b-8722-0b71ec90c3ab None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.626321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3adc62-68d3-4b0c-a2fc-ad0ada9bf4d9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.660413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c5961-3966-4d72-9cfd-2cbf7d394147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.661297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c5961-3966-4d72-9cfd-2cbf7d394147 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.661599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c5961-3966-4d72-9cfd-2cbf7d394147 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.661877 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c5961-3966-4d72-9cfd-2cbf7d394147 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.663081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c5961-3966-4d72-9cfd-2cbf7d394147 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.664543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920c5961-3966-4d72-9cfd-2cbf7d394147 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.666258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 48/88] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:14.667076 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c5961-3966-4d72-9cfd-2cbf7d394147 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.718555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9321dac6-7125-407b-8722-0b71ec90c3ab None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.721973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.744609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.753653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acf17a-4863-4e62-829a-735b8221b5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.754333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf17a-4863-4e62-829a-735b8221b5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.754623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf17a-4863-4e62-829a-735b8221b5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.754900 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acf17a-4863-4e62-829a-735b8221b5c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.765390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c5961-3966-4d72-9cfd-2cbf7d394147 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.798229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f305-fe5e-47e2-9dfa-7dbd2b823eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.798879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f305-fe5e-47e2-9dfa-7dbd2b823eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.799169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f305-fe5e-47e2-9dfa-7dbd2b823eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.799450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6371f305-fe5e-47e2-9dfa-7dbd2b823eb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.800290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371f305-fe5e-47e2-9dfa-7dbd2b823eb4 None admin] RBAC: Adding query filter params (role.id=faabf98abc6d4899b452e792928050ca, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba, user.id=34ed119cc247421babe93929a9f89aa8) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:14.800606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371f305-fe5e-47e2-9dfa-7dbd2b823eb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.802065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6371f305-fe5e-47e2-9dfa-7dbd2b823eb4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.807962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 49/89] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/role_assignments?user.id=34ed119cc247421babe93929a9f89aa8&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=faabf98abc6d4899b452e792928050ca => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:14.808713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f305-fe5e-47e2-9dfa-7dbd2b823eb4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.822210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acf17a-4863-4e62-829a-735b8221b5c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.823732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acf17a-4863-4e62-829a-735b8221b5c9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:14.938454 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6371f305-fe5e-47e2-9dfa-7dbd2b823eb4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:14.939455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 41/90] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:14.940399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acf17a-4863-4e62-829a-735b8221b5c9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:14.961192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.975172 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:14.979638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd180d-fc8d-4bc7-816b-a07a17415077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:14.980337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd180d-fc8d-4bc7-816b-a07a17415077 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:14.980623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd180d-fc8d-4bc7-816b-a07a17415077 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:14.980902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd180d-fc8d-4bc7-816b-a07a17415077 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:14.981628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd180d-fc8d-4bc7-816b-a07a17415077 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:14.983923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd180d-fc8d-4bc7-816b-a07a17415077 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.014264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 50/91] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:28:14 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:15.014264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd180d-fc8d-4bc7-816b-a07a17415077 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:15.059821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acf17a-4863-4e62-829a-735b8221b5c9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.113039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89619a-cb9b-4f08-a341-9d29d3fbdab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.114022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89619a-cb9b-4f08-a341-9d29d3fbdab8 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.114343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89619a-cb9b-4f08-a341-9d29d3fbdab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.114629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89619a-cb9b-4f08-a341-9d29d3fbdab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.122395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd180d-fc8d-4bc7-816b-a07a17415077 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.166058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f4c35-eda3-4b63-8cb4-acf17a6b8bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.166756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f4c35-eda3-4b63-8cb4-acf17a6b8bab None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.167037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f4c35-eda3-4b63-8cb4-acf17a6b8bab None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.167314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2f4c35-eda3-4b63-8cb4-acf17a6b8bab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.168240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f4c35-eda3-4b63-8cb4-acf17a6b8bab None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba, user.id=d9d908e34eee4ec195fa8ce65957cba5) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:15.168555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f4c35-eda3-4b63-8cb4-acf17a6b8bab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.170121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2f4c35-eda3-4b63-8cb4-acf17a6b8bab None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.176975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 51/92] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:15 2022] GET /identity/v3/role_assignments?user.id=d9d908e34eee4ec195fa8ce65957cba5&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=308d9785120a49079e02659953a2b033 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:15.178404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f4c35-eda3-4b63-8cb4-acf17a6b8bab None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:15.207764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89619a-cb9b-4f08-a341-9d29d3fbdab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.209703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89619a-cb9b-4f08-a341-9d29d3fbdab8 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.228658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:15.252507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:15.304667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2f4c35-eda3-4b63-8cb4-acf17a6b8bab None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.335557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 42/93] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:15.341303 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89619a-cb9b-4f08-a341-9d29d3fbdab8 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:15.343603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0dc36-485e-4bd8-80d1-5c4585e819a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.344588 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0dc36-485e-4bd8-80d1-5c4585e819a8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.344880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0dc36-485e-4bd8-80d1-5c4585e819a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.345154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb0dc36-485e-4bd8-80d1-5c4585e819a8 None admin] PATH_INFO: `/v3/projects/21a03eb555254350b3cab25eb7db88e2` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.346496 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0dc36-485e-4bd8-80d1-5c4585e819a8 None admin] RBAC: Authorizing `identity:get_project(project_id=21a03eb555254350b3cab25eb7db88e2)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.347985 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb0dc36-485e-4bd8-80d1-5c4585e819a8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.350782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 52/94] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:15 2022] GET /identity/v3/projects/21a03eb555254350b3cab25eb7db88e2 => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:15.359871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0dc36-485e-4bd8-80d1-5c4585e819a8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:15.471354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89619a-cb9b-4f08-a341-9d29d3fbdab8 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.495312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb0dc36-485e-4bd8-80d1-5c4585e819a8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.503122 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:15.514262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e0df4-765f-432d-8699-f6690797fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.515297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e0df4-765f-432d-8699-f6690797fb46 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.515584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e0df4-765f-432d-8699-f6690797fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.515861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e0df4-765f-432d-8699-f6690797fb46 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.517444 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e0df4-765f-432d-8699-f6690797fb46 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.518622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:15.519566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e0df4-765f-432d-8699-f6690797fb46 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.522868 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 43/95] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:15 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:15.530103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e0df4-765f-432d-8699-f6690797fb46 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:15.541993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1252598-24fe-4f06-b8a3-7d9e767f0777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.542959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1252598-24fe-4f06-b8a3-7d9e767f0777 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.543349 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1252598-24fe-4f06-b8a3-7d9e767f0777 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.543754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1252598-24fe-4f06-b8a3-7d9e767f0777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.544820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1252598-24fe-4f06-b8a3-7d9e767f0777 None admin] RBAC: Adding query filter params (role.id=faabf98abc6d4899b452e792928050ca, scope.project.id=21a03eb555254350b3cab25eb7db88e2, user.id=34ed119cc247421babe93929a9f89aa8) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:15.545249 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1252598-24fe-4f06-b8a3-7d9e767f0777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.547113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1252598-24fe-4f06-b8a3-7d9e767f0777 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.555205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 53/96] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:15 2022] GET /identity/v3/role_assignments?user.id=34ed119cc247421babe93929a9f89aa8&scope.project.id=21a03eb555254350b3cab25eb7db88e2&role.id=faabf98abc6d4899b452e792928050ca => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:15.645869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e0df4-765f-432d-8699-f6690797fb46 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:15.684065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b9ca4-5f04-4b68-b2c6-925754adba8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:15.684788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b9ca4-5f04-4b68-b2c6-925754adba8d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:15.685083 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b9ca4-5f04-4b68-b2c6-925754adba8d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:15.685359 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b9ca4-5f04-4b68-b2c6-925754adba8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:15.686250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b9ca4-5f04-4b68-b2c6-925754adba8d None admin] RBAC: Adding query filter params (role.id=5cb95ca9624d408a80d77ecc45d0c310, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba, user.id=34ed119cc247421babe93929a9f89aa8) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:15.686561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b9ca4-5f04-4b68-b2c6-925754adba8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:15.688049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b9ca4-5f04-4b68-b2c6-925754adba8d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:15.702259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 44/97] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:15 2022] GET /identity/v3/role_assignments?user.id=34ed119cc247421babe93929a9f89aa8&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=5cb95ca9624d408a80d77ecc45d0c310 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:17.347759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25654fde-3f68-411f-b716-eb68b7de5ec0 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.348261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25654fde-3f68-411f-b716-eb68b7de5ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.348333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25654fde-3f68-411f-b716-eb68b7de5ec0 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.350273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 54/98] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:17.355583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53bfd6-41ce-41f6-b8ee-786b3f08e625 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.355983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53bfd6-41ce-41f6-b8ee-786b3f08e625 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.356144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53bfd6-41ce-41f6-b8ee-786b3f08e625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.383281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-cf53bfd6-41ce-41f6-b8ee-786b3f08e625 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:17.384529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-cf53bfd6-41ce-41f6-b8ee-786b3f08e625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:17.458055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:17.476677 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 45/99] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:17.511032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25654fde-3f68-411f-b716-eb68b7de5ec0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:17.642521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25654fde-3f68-411f-b716-eb68b7de5ec0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:17.691045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3a4c5-55f3-4c0f-8968-3c8755169b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:17.691881 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a4c5-55f3-4c0f-8968-3c8755169b4b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.692170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a4c5-55f3-4c0f-8968-3c8755169b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.692446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3a4c5-55f3-4c0f-8968-3c8755169b4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.709718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3a4c5-55f3-4c0f-8968-3c8755169b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-adb3a4c5-55f3-4c0f-8968-3c8755169b4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:17.717668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:17.718547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:17.719276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 55/100] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:17.725537 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53bfd6-41ce-41f6-b8ee-786b3f08e625 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:17.893603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53bfd6-41ce-41f6-b8ee-786b3f08e625 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:17.929164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2174d66-1ea8-4a2a-b594-b9381f642ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:17.929839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2174d66-1ea8-4a2a-b594-b9381f642ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:17.930144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2174d66-1ea8-4a2a-b594-b9381f642ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:17.930427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2174d66-1ea8-4a2a-b594-b9381f642ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:17.931194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2174d66-1ea8-4a2a-b594-b9381f642ae7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:17.931502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2174d66-1ea8-4a2a-b594-b9381f642ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:17.932887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2174d66-1ea8-4a2a-b594-b9381f642ae7 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:17.942044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 46/101] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:17.951204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3a4c5-55f3-4c0f-8968-3c8755169b4b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.018222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.085933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164cfa2-7d69-4149-aaa3-850fecaadeb5 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.086619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164cfa2-7d69-4149-aaa3-850fecaadeb5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.087126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9164cfa2-7d69-4149-aaa3-850fecaadeb5 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.088726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 47/102] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:18.095115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dfb7b-752d-4109-928a-5c620b11c1f4 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.095742 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dfb7b-752d-4109-928a-5c620b11c1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.096325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dfb7b-752d-4109-928a-5c620b11c1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.116445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d58dfb7b-752d-4109-928a-5c620b11c1f4 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:18.118564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d58dfb7b-752d-4109-928a-5c620b11c1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:18.119656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3a4c5-55f3-4c0f-8968-3c8755169b4b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.156848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66ab25-a78b-4c67-9eaa-2e6b691723d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.157732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66ab25-a78b-4c67-9eaa-2e6b691723d9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.158019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66ab25-a78b-4c67-9eaa-2e6b691723d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.158328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66ab25-a78b-4c67-9eaa-2e6b691723d9 None admin] PATH_INFO: `/v3/users/34ed119cc247421babe93929a9f89aa8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.159515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66ab25-a78b-4c67-9eaa-2e6b691723d9 None admin] RBAC: Authorizing `identity:get_user(user_id=34ed119cc247421babe93929a9f89aa8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.160989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66ab25-a78b-4c67-9eaa-2e6b691723d9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.164150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 56/103] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:17 2022] GET /identity/v3/users/34ed119cc247421babe93929a9f89aa8 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:18.169414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66ab25-a78b-4c67-9eaa-2e6b691723d9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.178509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.210239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 48/104] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:18.229462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dfb7b-752d-4109-928a-5c620b11c1f4 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.338342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dfb7b-752d-4109-928a-5c620b11c1f4 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.376898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633ac1b-b173-4a7d-b062-26816e9c0a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.378637 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ac1b-b173-4a7d-b062-26816e9c0a29 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.379119 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ac1b-b173-4a7d-b062-26816e9c0a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.379585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633ac1b-b173-4a7d-b062-26816e9c0a29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.391737 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633ac1b-b173-4a7d-b062-26816e9c0a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-1633ac1b-b173-4a7d-b062-26816e9c0a29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:18.400218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:18.401044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:18.401775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:18.404479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 49/105] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:18.410627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633ac1b-b173-4a7d-b062-26816e9c0a29 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.414325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.423267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66ab25-a78b-4c67-9eaa-2e6b691723d9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.459025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.511526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de37b9a-6061-48af-8846-17061aa539f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.512105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de37b9a-6061-48af-8846-17061aa539f5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.512393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de37b9a-6061-48af-8846-17061aa539f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.512674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de37b9a-6061-48af-8846-17061aa539f5 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.514147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de37b9a-6061-48af-8846-17061aa539f5 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.515667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de37b9a-6061-48af-8846-17061aa539f5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.517529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 57/106] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:18.524136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de37b9a-6061-48af-8846-17061aa539f5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.529177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633ac1b-b173-4a7d-b062-26816e9c0a29 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.567697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dabb9-db7a-45ce-b020-d6e8f9156594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.569291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dabb9-db7a-45ce-b020-d6e8f9156594 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.569770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dabb9-db7a-45ce-b020-d6e8f9156594 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.570293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dabb9-db7a-45ce-b020-d6e8f9156594 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.571303 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dabb9-db7a-45ce-b020-d6e8f9156594 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:18.571799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dabb9-db7a-45ce-b020-d6e8f9156594 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.573439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2dabb9-db7a-45ce-b020-d6e8f9156594 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.582833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 50/107] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:18.608779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dabb9-db7a-45ce-b020-d6e8f9156594 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.673603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de37b9a-6061-48af-8846-17061aa539f5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.712787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1839e-c5d5-4445-9595-ef67283d0b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.713693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1839e-c5d5-4445-9595-ef67283d0b52 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.713984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1839e-c5d5-4445-9595-ef67283d0b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.715832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1839e-c5d5-4445-9595-ef67283d0b52 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/users/34ed119cc247421babe93929a9f89aa8/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.722986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1839e-c5d5-4445-9595-ef67283d0b52 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b4124e2ef54662829ffdfde18ae8ba, user_id=34ed119cc247421babe93929a9f89aa8, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.724761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1839e-c5d5-4445-9595-ef67283d0b52 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.759658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dabb9-db7a-45ce-b020-d6e8f9156594 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:18.759840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.762750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 58/108] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:28:18 2022] PUT /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/users/34ed119cc247421babe93929a9f89aa8/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:28:18.765115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccc18a-bb00-458c-aa08-388f0ee2eb6c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.765636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccc18a-bb00-458c-aa08-388f0ee2eb6c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.766276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cccc18a-bb00-458c-aa08-388f0ee2eb6c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.768021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 59/109] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:18.776066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07572e1-0bb4-4f8a-aef5-d4386cf19db4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.776728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07572e1-0bb4-4f8a-aef5-d4386cf19db4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.777205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07572e1-0bb4-4f8a-aef5-d4386cf19db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.811910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31153d9d-7c9b-4f2d-86e8-a2a18ad6ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:18.812835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31153d9d-7c9b-4f2d-86e8-a2a18ad6ab73 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.813123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31153d9d-7c9b-4f2d-86e8-a2a18ad6ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.813406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31153d9d-7c9b-4f2d-86e8-a2a18ad6ab73 None admin] PATH_INFO: `/v3/users/d9d908e34eee4ec195fa8ce65957cba5` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.819143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31153d9d-7c9b-4f2d-86e8-a2a18ad6ab73 None admin] RBAC: Authorizing `identity:get_user(user_id=d9d908e34eee4ec195fa8ce65957cba5)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:18.820117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b07572e1-0bb4-4f8a-aef5-d4386cf19db4 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:18.821392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b07572e1-0bb4-4f8a-aef5-d4386cf19db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:18.824780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31153d9d-7c9b-4f2d-86e8-a2a18ad6ab73 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:18.835157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 51/110] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/users/d9d908e34eee4ec195fa8ce65957cba5 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:18.846606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31153d9d-7c9b-4f2d-86e8-a2a18ad6ab73 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:18.894127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:18.952281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 60/111] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:18.953947 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66091ae-1eee-42a2-a0a8-ecb3d16b5866 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.954496 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66091ae-1eee-42a2-a0a8-ecb3d16b5866 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.954996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66091ae-1eee-42a2-a0a8-ecb3d16b5866 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:18.957451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 61/112] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:18.967928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c86fee-6224-442e-aa3f-1365d611b9a2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:18.968559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c86fee-6224-442e-aa3f-1365d611b9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:18.969068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c86fee-6224-442e-aa3f-1365d611b9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.004458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-26c86fee-6224-442e-aa3f-1365d611b9a2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:19.010645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-26c86fee-6224-442e-aa3f-1365d611b9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:19.019137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31153d9d-7c9b-4f2d-86e8-a2a18ad6ab73 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.062401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9ed3d-8d90-4691-998d-4e8e33728875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.064912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9ed3d-8d90-4691-998d-4e8e33728875 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.065207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9ed3d-8d90-4691-998d-4e8e33728875 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.065636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a9ed3d-8d90-4691-998d-4e8e33728875 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.066966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9ed3d-8d90-4691-998d-4e8e33728875 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.069117 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a9ed3d-8d90-4691-998d-4e8e33728875 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.071494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 52/113] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:18 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:19.072268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9ed3d-8d90-4691-998d-4e8e33728875 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.120431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 62/114] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:19.121091 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c86fee-6224-442e-aa3f-1365d611b9a2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.125489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.193357 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a9ed3d-8d90-4691-998d-4e8e33728875 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.224029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.237052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41b5ed-12f9-43a2-a531-53f73e2f0989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.238395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41b5ed-12f9-43a2-a531-53f73e2f0989 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.238395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41b5ed-12f9-43a2-a531-53f73e2f0989 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.238892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41b5ed-12f9-43a2-a531-53f73e2f0989 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.241813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c86fee-6224-442e-aa3f-1365d611b9a2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.252051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e41b5ed-12f9-43a2-a531-53f73e2f0989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-7e41b5ed-12f9-43a2-a531-53f73e2f0989 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:19.261441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:19.262573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:19.263349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 53/115] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:19.264634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41b5ed-12f9-43a2-a531-53f73e2f0989 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.288391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf58db3-0334-4f0a-a3aa-75bbc096241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.289639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58db3-0334-4f0a-a3aa-75bbc096241a None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.290204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58db3-0334-4f0a-a3aa-75bbc096241a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.290682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf58db3-0334-4f0a-a3aa-75bbc096241a None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/users/d9d908e34eee4ec195fa8ce65957cba5/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.293072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf58db3-0334-4f0a-a3aa-75bbc096241a None admin] RBAC: Authorizing `identity:create_grant(project_id=00b4124e2ef54662829ffdfde18ae8ba, user_id=d9d908e34eee4ec195fa8ce65957cba5, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.294950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf58db3-0334-4f0a-a3aa-75bbc096241a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.323961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 63/116] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:28:19 2022] PUT /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/users/d9d908e34eee4ec195fa8ce65957cba5/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:19.325084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf58db3-0334-4f0a-a3aa-75bbc096241a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.388769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.393890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41b5ed-12f9-43a2-a531-53f73e2f0989 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.432306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7214cd2-3a41-46ab-9e4e-8c8ddc412824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.433136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7214cd2-3a41-46ab-9e4e-8c8ddc412824 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.433425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7214cd2-3a41-46ab-9e4e-8c8ddc412824 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.433708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7214cd2-3a41-46ab-9e4e-8c8ddc412824 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.446406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7214cd2-3a41-46ab-9e4e-8c8ddc412824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-d7214cd2-3a41-46ab-9e4e-8c8ddc412824 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:19.455260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:19.456244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:19.456972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 54/117] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:19.462639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7214cd2-3a41-46ab-9e4e-8c8ddc412824 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.528526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf58db3-0334-4f0a-a3aa-75bbc096241a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.579979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7214cd2-3a41-46ab-9e4e-8c8ddc412824 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.592889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b7788-7976-4260-bb6f-28d65bf33210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.594005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7788-7976-4260-bb6f-28d65bf33210 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.594538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7788-7976-4260-bb6f-28d65bf33210 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.595024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b7788-7976-4260-bb6f-28d65bf33210 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.596137 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7788-7976-4260-bb6f-28d65bf33210 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:19.596771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7788-7976-4260-bb6f-28d65bf33210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.598452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b7788-7976-4260-bb6f-28d65bf33210 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.616053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 64/118] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:19.617733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b018c46-4e7c-475f-be49-b74aadf6c3fc None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.618300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b018c46-4e7c-475f-be49-b74aadf6c3fc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.618792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b018c46-4e7c-475f-be49-b74aadf6c3fc None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.619073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc07a1-3061-4afc-a781-7cde50929ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.619760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc07a1-3061-4afc-a781-7cde50929ecd None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.620051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc07a1-3061-4afc-a781-7cde50929ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.620334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc07a1-3061-4afc-a781-7cde50929ecd None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.621106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc07a1-3061-4afc-a781-7cde50929ecd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:19.621433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc07a1-3061-4afc-a781-7cde50929ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.621964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 65/119] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:19.622925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b018c46-4e7c-475f-be49-b74aadf6c3fc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.627325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acc07a1-3061-4afc-a781-7cde50929ecd None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.633784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 55/120] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:19.634966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344fed6-10bc-49d1-ae28-8c4014d7828e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.635266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344fed6-10bc-49d1-ae28-8c4014d7828e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.635804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344fed6-10bc-49d1-ae28-8c4014d7828e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.644013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.652503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7344fed6-10bc-49d1-ae28-8c4014d7828e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:19.653724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7344fed6-10bc-49d1-ae28-8c4014d7828e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:19.670729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.732783 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 56/121] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:19.733642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344fed6-10bc-49d1-ae28-8c4014d7828e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.744151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b018c46-4e7c-475f-be49-b74aadf6c3fc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.782987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24d53c2-3eb7-4d5b-bc02-a685112d5f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.783793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d53c2-3eb7-4d5b-bc02-a685112d5f43 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.784078 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d53c2-3eb7-4d5b-bc02-a685112d5f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.784355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24d53c2-3eb7-4d5b-bc02-a685112d5f43 None admin] PATH_INFO: `/v3/users/0da5290c3d8842fca5dbee4c24dea4b3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.799596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d53c2-3eb7-4d5b-bc02-a685112d5f43 None admin] RBAC: Authorizing `identity:get_user(user_id=0da5290c3d8842fca5dbee4c24dea4b3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.801090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24d53c2-3eb7-4d5b-bc02-a685112d5f43 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.807238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 66/122] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/users/0da5290c3d8842fca5dbee4c24dea4b3 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:19.807238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67726fda-2a98-4c90-b7b9-19f2cf9740c4 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.807238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67726fda-2a98-4c90-b7b9-19f2cf9740c4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.807238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67726fda-2a98-4c90-b7b9-19f2cf9740c4 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.807238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 67/123] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:19.812355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67726fda-2a98-4c90-b7b9-19f2cf9740c4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:19.868798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344fed6-10bc-49d1-ae28-8c4014d7828e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.906532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:19.912594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872648c-993c-4beb-b5c0-bb677e330b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:19.913712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872648c-993c-4beb-b5c0-bb677e330b24 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.914216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872648c-993c-4beb-b5c0-bb677e330b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.914689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872648c-993c-4beb-b5c0-bb677e330b24 None admin] PATH_INFO: `/v3/users/34ed119cc247421babe93929a9f89aa8` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.916067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872648c-993c-4beb-b5c0-bb677e330b24 None admin] RBAC: Authorizing `identity:get_user(user_id=34ed119cc247421babe93929a9f89aa8)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:19.918154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872648c-993c-4beb-b5c0-bb677e330b24 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:19.920658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 57/124] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/users/34ed119cc247421babe93929a9f89aa8 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:19.922166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd6a38-3748-4bd0-90a3-d292a14c58e2 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:19.922649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd6a38-3748-4bd0-90a3-d292a14c58e2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:19.923105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bd6a38-3748-4bd0-90a3-d292a14c58e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:19.943512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-79bd6a38-3748-4bd0-90a3-d292a14c58e2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:19.945659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-79bd6a38-3748-4bd0-90a3-d292a14c58e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:19.956132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67726fda-2a98-4c90-b7b9-19f2cf9740c4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:19.963060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.003254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a92dea-b918-405f-b48c-21d5366e428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.004504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a92dea-b918-405f-b48c-21d5366e428e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.004889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a92dea-b918-405f-b48c-21d5366e428e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.005300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a92dea-b918-405f-b48c-21d5366e428e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.018165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a92dea-b918-405f-b48c-21d5366e428e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:20.027993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 58/125] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:20.029198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd6a38-3748-4bd0-90a3-d292a14c58e2 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c7a92dea-b918-405f-b48c-21d5366e428e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:20.035300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:20.036176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:20.037473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:20.042840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 68/126] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:20.043924 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a92dea-b918-405f-b48c-21d5366e428e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.146669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bd6a38-3748-4bd0-90a3-d292a14c58e2 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.152332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a92dea-b918-405f-b48c-21d5366e428e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.180021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.181330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec42ea-193d-40f7-a0fa-afb414d4583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.182005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec42ea-193d-40f7-a0fa-afb414d4583f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.182335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec42ea-193d-40f7-a0fa-afb414d4583f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.182768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec42ea-193d-40f7-a0fa-afb414d4583f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.190802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79f9fb-b6f1-4b4d-9963-453236af962c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.192000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79f9fb-b6f1-4b4d-9963-453236af962c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.192517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79f9fb-b6f1-4b4d-9963-453236af962c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.193074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79f9fb-b6f1-4b4d-9963-453236af962c None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.194517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79f9fb-b6f1-4b4d-9963-453236af962c None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.196183 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79f9fb-b6f1-4b4d-9963-453236af962c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.198191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 69/127] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:20.199319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79f9fb-b6f1-4b4d-9963-453236af962c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.210449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.260903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec42ea-193d-40f7-a0fa-afb414d4583f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.263060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eec42ea-193d-40f7-a0fa-afb414d4583f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.311155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79f9fb-b6f1-4b4d-9963-453236af962c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.346792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c079-f49f-49fa-8299-07c37ce2890b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.347754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c079-f49f-49fa-8299-07c37ce2890b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.348242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c079-f49f-49fa-8299-07c37ce2890b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.348756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc0c079-f49f-49fa-8299-07c37ce2890b None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.350311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0c079-f49f-49fa-8299-07c37ce2890b None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:20.350833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0c079-f49f-49fa-8299-07c37ce2890b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.352428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc0c079-f49f-49fa-8299-07c37ce2890b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.361339 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 70/128] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:20.362632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c079-f49f-49fa-8299-07c37ce2890b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.375573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 59/129] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:20.376350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec42ea-193d-40f7-a0fa-afb414d4583f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.426789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.450651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.474231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc0c079-f49f-49fa-8299-07c37ce2890b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.490444 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec42ea-193d-40f7-a0fa-afb414d4583f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.511168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041fc73-3769-48b6-8b6d-302264beac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.512321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041fc73-3769-48b6-8b6d-302264beac65 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.512920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041fc73-3769-48b6-8b6d-302264beac65 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.513406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e041fc73-3769-48b6-8b6d-302264beac65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.515041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041fc73-3769-48b6-8b6d-302264beac65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.516860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e041fc73-3769-48b6-8b6d-302264beac65 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.518779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 71/130] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:20.519792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041fc73-3769-48b6-8b6d-302264beac65 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.538808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ff0e-a5b5-439e-aa7f-73a6b6138dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.539962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ff0e-a5b5-439e-aa7f-73a6b6138dae None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.540249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ff0e-a5b5-439e-aa7f-73a6b6138dae None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.540526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ff0e-a5b5-439e-aa7f-73a6b6138dae None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/users/34ed119cc247421babe93929a9f89aa8/roles/5cb95ca9624d408a80d77ecc45d0c310` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.543734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36ff0e-a5b5-439e-aa7f-73a6b6138dae None admin] RBAC: Authorizing `identity:create_grant(project_id=00b4124e2ef54662829ffdfde18ae8ba, user_id=34ed119cc247421babe93929a9f89aa8, role_id=5cb95ca9624d408a80d77ecc45d0c310)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.545588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb36ff0e-a5b5-439e-aa7f-73a6b6138dae None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.562565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 60/131] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:28:20 2022] PUT /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/users/34ed119cc247421babe93929a9f89aa8/roles/5cb95ca9624d408a80d77ecc45d0c310 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:20.566904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ff0e-a5b5-439e-aa7f-73a6b6138dae None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.706735 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e041fc73-3769-48b6-8b6d-302264beac65 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.722280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ff0e-a5b5-439e-aa7f-73a6b6138dae None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.734767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.762475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:20.767643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9795c2-02f9-426f-9578-c7e2630aae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.768842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9795c2-02f9-426f-9578-c7e2630aae98 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.769339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9795c2-02f9-426f-9578-c7e2630aae98 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.769789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9795c2-02f9-426f-9578-c7e2630aae98 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.771906 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9795c2-02f9-426f-9578-c7e2630aae98 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.773767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9795c2-02f9-426f-9578-c7e2630aae98 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.775897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 61/132] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:20.777145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9795c2-02f9-426f-9578-c7e2630aae98 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.795523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795faf62-96bf-40ea-bee3-8a6eb8bffd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.796441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795faf62-96bf-40ea-bee3-8a6eb8bffd5c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.796726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795faf62-96bf-40ea-bee3-8a6eb8bffd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.797004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795faf62-96bf-40ea-bee3-8a6eb8bffd5c None admin] PATH_INFO: `/v3/users/34ed119cc247421babe93929a9f89aa8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.798904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795faf62-96bf-40ea-bee3-8a6eb8bffd5c None admin] RBAC: Authorizing `identity:get_user(user_id=34ed119cc247421babe93929a9f89aa8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.800433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795faf62-96bf-40ea-bee3-8a6eb8bffd5c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.802958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 72/133] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/users/34ed119cc247421babe93929a9f89aa8 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:20.803604 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795faf62-96bf-40ea-bee3-8a6eb8bffd5c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.899280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9795c2-02f9-426f-9578-c7e2630aae98 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.935325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795faf62-96bf-40ea-bee3-8a6eb8bffd5c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:20.936905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddf168-e5b0-459e-b672-0871c725eff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.937876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddf168-e5b0-459e-b672-0871c725eff1 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.938372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddf168-e5b0-459e-b672-0871c725eff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.938812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddf168-e5b0-459e-b672-0871c725eff1 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.939729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddf168-e5b0-459e-b672-0871c725eff1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.941440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddf168-e5b0-459e-b672-0871c725eff1 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.973433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 62/134] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:28:20 2022] POST /identity/v3/projects => generated 302 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:20.973692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a23c39-8fd0-4e91-99ba-52799bd76c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:20.974583 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a23c39-8fd0-4e91-99ba-52799bd76c9a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:20.974933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a23c39-8fd0-4e91-99ba-52799bd76c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:20.975290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a23c39-8fd0-4e91-99ba-52799bd76c9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:20.975559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddf168-e5b0-459e-b672-0871c725eff1 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:20.978585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a23c39-8fd0-4e91-99ba-52799bd76c9a None admin] RBAC: Adding query filter params (role.id=e6190de07af44357a40a6be75cf7431c, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba, user.id=0da5290c3d8842fca5dbee4c24dea4b3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:20.978585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a23c39-8fd0-4e91-99ba-52799bd76c9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:20.978585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a23c39-8fd0-4e91-99ba-52799bd76c9a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:20.986000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 73/135] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/role_assignments?user.id=0da5290c3d8842fca5dbee4c24dea4b3&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=e6190de07af44357a40a6be75cf7431c => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:21.033618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:21.142966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddf168-e5b0-459e-b672-0871c725eff1 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:21.190062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfee3fa-703c-4414-a24f-08430ee1c443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:21.190992 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfee3fa-703c-4414-a24f-08430ee1c443 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.191278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfee3fa-703c-4414-a24f-08430ee1c443 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.191557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfee3fa-703c-4414-a24f-08430ee1c443 None admin] PATH_INFO: `/v3/projects/21a03eb555254350b3cab25eb7db88e2` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.193315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfee3fa-703c-4414-a24f-08430ee1c443 None admin] RBAC: Authorizing `identity:get_project(project_id=21a03eb555254350b3cab25eb7db88e2)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:21.194878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfee3fa-703c-4414-a24f-08430ee1c443 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:21.196676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 63/136] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:20 2022] GET /identity/v3/projects/21a03eb555254350b3cab25eb7db88e2 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:21.202470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a23c39-8fd0-4e91-99ba-52799bd76c9a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:21.270110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:21.337923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a23c39-8fd0-4e91-99ba-52799bd76c9a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:21.380708 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d162e2-ed28-4d3c-a389-50a04a3ae006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:21.381623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d162e2-ed28-4d3c-a389-50a04a3ae006 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.381904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d162e2-ed28-4d3c-a389-50a04a3ae006 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.382202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d162e2-ed28-4d3c-a389-50a04a3ae006 None admin] PATH_INFO: `/v3/projects/21a03eb555254350b3cab25eb7db88e2/users/34ed119cc247421babe93929a9f89aa8/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.384238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d162e2-ed28-4d3c-a389-50a04a3ae006 None admin] RBAC: Authorizing `identity:create_grant(project_id=21a03eb555254350b3cab25eb7db88e2, user_id=34ed119cc247421babe93929a9f89aa8, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:21.386104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d162e2-ed28-4d3c-a389-50a04a3ae006 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:21.405101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 74/137] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:28:21 2022] PUT /identity/v3/projects/21a03eb555254350b3cab25eb7db88e2/users/34ed119cc247421babe93929a9f89aa8/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:21.528416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c922cc2-287d-4a0f-8c85-176da841775b None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.528905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c922cc2-287d-4a0f-8c85-176da841775b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.528975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c922cc2-287d-4a0f-8c85-176da841775b None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.530678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 64/138] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:21.536826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72237-d9ee-41b8-8aed-d794e0a860b1 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.537486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72237-d9ee-41b8-8aed-d794e0a860b1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.538002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd72237-d9ee-41b8-8aed-d794e0a860b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.557048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ecd72237-d9ee-41b8-8aed-d794e0a860b1 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:21.558716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ecd72237-d9ee-41b8-8aed-d794e0a860b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:21.648796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 75/139] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:21.686876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c922cc2-287d-4a0f-8c85-176da841775b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:21.822998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:21.830657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c922cc2-287d-4a0f-8c85-176da841775b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:21.877243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bec0b-d58a-4735-b240-ead01a3eda5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:21.878248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bec0b-d58a-4735-b240-ead01a3eda5b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.878641 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bec0b-d58a-4735-b240-ead01a3eda5b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.879040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bec0b-d58a-4735-b240-ead01a3eda5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.894016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bec0b-d58a-4735-b240-ead01a3eda5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-bd6bec0b-d58a-4735-b240-ead01a3eda5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:21.902834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:21.903865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:21.904788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:21.910443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 65/140] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:21.919202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd72237-d9ee-41b8-8aed-d794e0a860b1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:21.983341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b81c2-0f2d-4899-8c75-20d8b891f1df None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.983632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b81c2-0f2d-4899-8c75-20d8b891f1df None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.983838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9b81c2-0f2d-4899-8c75-20d8b891f1df None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:21.985236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 66/141] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:21.990443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5075c-93ed-4734-afcc-41601e8b36d9 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:21.990745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5075c-93ed-4734-afcc-41601e8b36d9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:21.991032 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f5075c-93ed-4734-afcc-41601e8b36d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.014493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:22.022536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-b6f5075c-93ed-4734-afcc-41601e8b36d9 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:22.023768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b6f5075c-93ed-4734-afcc-41601e8b36d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:22.110475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd72237-d9ee-41b8-8aed-d794e0a860b1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.182759 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 67/142] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:22.191321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3e387-44b4-43ba-9cb9-5d060a82028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.191997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3e387-44b4-43ba-9cb9-5d060a82028c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.192277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3e387-44b4-43ba-9cb9-5d060a82028c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.193205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee3e387-44b4-43ba-9cb9-5d060a82028c None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.193967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3e387-44b4-43ba-9cb9-5d060a82028c None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:22.194296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3e387-44b4-43ba-9cb9-5d060a82028c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.195693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee3e387-44b4-43ba-9cb9-5d060a82028c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:22.213701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 76/143] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:22.219183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5075c-93ed-4734-afcc-41601e8b36d9 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.221519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3e387-44b4-43ba-9cb9-5d060a82028c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.384749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:22.413294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f5075c-93ed-4734-afcc-41601e8b36d9 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.444222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee3e387-44b4-43ba-9cb9-5d060a82028c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.467556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:22.483857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799163ad-4384-4850-84c3-18b8bece1382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.485077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799163ad-4384-4850-84c3-18b8bece1382 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.485363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799163ad-4384-4850-84c3-18b8bece1382 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.485643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799163ad-4384-4850-84c3-18b8bece1382 None admin] PATH_INFO: `/v3/users/34ed119cc247421babe93929a9f89aa8` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.486909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799163ad-4384-4850-84c3-18b8bece1382 None admin] RBAC: Authorizing `identity:get_user(user_id=34ed119cc247421babe93929a9f89aa8)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.488854 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799163ad-4384-4850-84c3-18b8bece1382 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:22.490903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 68/144] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:22 2022] GET /identity/v3/users/34ed119cc247421babe93929a9f89aa8 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:22.496270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799163ad-4384-4850-84c3-18b8bece1382 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.524191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda6788-7e84-4a0a-a16d-99342d9346f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.525134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda6788-7e84-4a0a-a16d-99342d9346f7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.525424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda6788-7e84-4a0a-a16d-99342d9346f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.525695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda6788-7e84-4a0a-a16d-99342d9346f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.574728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda6788-7e84-4a0a-a16d-99342d9346f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-9fda6788-7e84-4a0a-a16d-99342d9346f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:22.582591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:22.583934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:22.585083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 77/145] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:28:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:22.590928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda6788-7e84-4a0a-a16d-99342d9346f7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.633048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799163ad-4384-4850-84c3-18b8bece1382 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.677556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c468e9-f209-4d76-83c1-2d20d60e0c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.678293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c468e9-f209-4d76-83c1-2d20d60e0c44 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.678645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c468e9-f209-4d76-83c1-2d20d60e0c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.678923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c468e9-f209-4d76-83c1-2d20d60e0c44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.729389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:22.770546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda6788-7e84-4a0a-a16d-99342d9346f7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:22.811406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c468e9-f209-4d76-83c1-2d20d60e0c44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.812892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c468e9-f209-4d76-83c1-2d20d60e0c44 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:22.838406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51149f2b-f8e6-4942-820f-a3cf5528f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:22.839078 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51149f2b-f8e6-4942-820f-a3cf5528f266 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:22.839358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51149f2b-f8e6-4942-820f-a3cf5528f266 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:22.839632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51149f2b-f8e6-4942-820f-a3cf5528f266 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:22.840378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51149f2b-f8e6-4942-820f-a3cf5528f266 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:22.840681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51149f2b-f8e6-4942-820f-a3cf5528f266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:22.842070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51149f2b-f8e6-4942-820f-a3cf5528f266 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:22.856770 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 78/146] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:22.863551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51149f2b-f8e6-4942-820f-a3cf5528f266 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:22.946524 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.033252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 69/147] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:23.040314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c468e9-f209-4d76-83c1-2d20d60e0c44 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.129440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51149f2b-f8e6-4942-820f-a3cf5528f266 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.132528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.200007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c468e9-f209-4d76-83c1-2d20d60e0c44 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.233596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be268-9d3a-4861-93ff-c5b97d3a6dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.234554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be268-9d3a-4861-93ff-c5b97d3a6dfb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.234838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be268-9d3a-4861-93ff-c5b97d3a6dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.235114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33be268-9d3a-4861-93ff-c5b97d3a6dfb None admin] PATH_INFO: `/v3/users/d9d908e34eee4ec195fa8ce65957cba5` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.236572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33be268-9d3a-4861-93ff-c5b97d3a6dfb None admin] RBAC: Authorizing `identity:get_user(user_id=d9d908e34eee4ec195fa8ce65957cba5)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:23.238056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33be268-9d3a-4861-93ff-c5b97d3a6dfb None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.248209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 79/148] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:22 2022] GET /identity/v3/users/d9d908e34eee4ec195fa8ce65957cba5 => generated 247 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:23.253253 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be268-9d3a-4861-93ff-c5b97d3a6dfb None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.265512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345dbbf-89fb-4797-b2bc-42c39c987e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.266711 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345dbbf-89fb-4797-b2bc-42c39c987e9d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.267213 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345dbbf-89fb-4797-b2bc-42c39c987e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.267688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345dbbf-89fb-4797-b2bc-42c39c987e9d None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.269106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345dbbf-89fb-4797-b2bc-42c39c987e9d None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:23.271347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345dbbf-89fb-4797-b2bc-42c39c987e9d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.273575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 70/149] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:23.288113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345dbbf-89fb-4797-b2bc-42c39c987e9d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.460253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345dbbf-89fb-4797-b2bc-42c39c987e9d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.484637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.485529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.492850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33be268-9d3a-4861-93ff-c5b97d3a6dfb None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.513128 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd127d-9cba-45d0-8971-98b110c1a028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.514175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd127d-9cba-45d0-8971-98b110c1a028 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.514679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd127d-9cba-45d0-8971-98b110c1a028 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.515153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd127d-9cba-45d0-8971-98b110c1a028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.516208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd127d-9cba-45d0-8971-98b110c1a028 None admin] RBAC: Adding query filter params (role.id=faabf98abc6d4899b452e792928050ca, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba, user.id=34ed119cc247421babe93929a9f89aa8) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:23.516719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd127d-9cba-45d0-8971-98b110c1a028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:23.518406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd127d-9cba-45d0-8971-98b110c1a028 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.529300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 71/150] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/role_assignments?user.id=34ed119cc247421babe93929a9f89aa8&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=faabf98abc6d4899b452e792928050ca => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:23.559890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfe5bf-a5de-44d5-830c-910c8ef5c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:23.561071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe5bf-a5de-44d5-830c-910c8ef5c164 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.561563 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe5bf-a5de-44d5-830c-910c8ef5c164 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.562037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfe5bf-a5de-44d5-830c-910c8ef5c164 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.658035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfe5bf-a5de-44d5-830c-910c8ef5c164 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:23.661786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfe5bf-a5de-44d5-830c-910c8ef5c164 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:23.790894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:23.798331 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 80/151] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:23.799967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd127d-9cba-45d0-8971-98b110c1a028 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:23.834271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67731535-088e-4d06-930f-e748a07d4d7e None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.834271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67731535-088e-4d06-930f-e748a07d4d7e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.834271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67731535-088e-4d06-930f-e748a07d4d7e None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.834271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 81/152] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:23.840125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583666a-299e-4aa4-8d78-bdc9368ad4f5 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:23.840410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583666a-299e-4aa4-8d78-bdc9368ad4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:23.840691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583666a-299e-4aa4-8d78-bdc9368ad4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:23.866486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2583666a-299e-4aa4-8d78-bdc9368ad4f5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:23.867715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2583666a-299e-4aa4-8d78-bdc9368ad4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:23.969946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd127d-9cba-45d0-8971-98b110c1a028 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:23.983155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 82/153] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:24.015252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583666a-299e-4aa4-8d78-bdc9368ad4f5 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.035294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16122f7a-601f-4c52-a90a-60efa27d80ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.036163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16122f7a-601f-4c52-a90a-60efa27d80ee None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.036501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16122f7a-601f-4c52-a90a-60efa27d80ee None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.036795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16122f7a-601f-4c52-a90a-60efa27d80ee None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.042977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16122f7a-601f-4c52-a90a-60efa27d80ee None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.044659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16122f7a-601f-4c52-a90a-60efa27d80ee None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.046710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 72/154] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:23 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:24.054016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16122f7a-601f-4c52-a90a-60efa27d80ee None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.150649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:24.192088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583666a-299e-4aa4-8d78-bdc9368ad4f5 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.198480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16122f7a-601f-4c52-a90a-60efa27d80ee None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.233838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69848c8a-304e-4a27-ba84-cdafbca96beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.234531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69848c8a-304e-4a27-ba84-cdafbca96beb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.234815 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69848c8a-304e-4a27-ba84-cdafbca96beb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.235092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69848c8a-304e-4a27-ba84-cdafbca96beb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.235934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69848c8a-304e-4a27-ba84-cdafbca96beb None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba, user.id=d9d908e34eee4ec195fa8ce65957cba5) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:24.236313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69848c8a-304e-4a27-ba84-cdafbca96beb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.237848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69848c8a-304e-4a27-ba84-cdafbca96beb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.242509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:24.244487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 73/155] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/role_assignments?user.id=d9d908e34eee4ec195fa8ce65957cba5&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=308d9785120a49079e02659953a2b033 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:24.252182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14277f-be62-4428-bbce-d465084bac96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.253004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14277f-be62-4428-bbce-d465084bac96 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.253290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14277f-be62-4428-bbce-d465084bac96 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.253559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14277f-be62-4428-bbce-d465084bac96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.276694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14277f-be62-4428-bbce-d465084bac96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-ad14277f-be62-4428-bbce-d465084bac96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:24.290967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:24.291899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:24.292733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 83/156] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:24.299848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69848c8a-304e-4a27-ba84-cdafbca96beb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.420454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69848c8a-304e-4a27-ba84-cdafbca96beb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.430874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f2aa-cb72-4759-80e2-a3333352c2b4 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.431160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f2aa-cb72-4759-80e2-a3333352c2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.431443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048f2aa-cb72-4759-80e2-a3333352c2b4 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.432869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 84/157] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:24.444396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:24.444596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f0c59-60e2-4c8d-a869-a4317b7fbe96 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.444690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f0c59-60e2-4c8d-a869-a4317b7fbe96 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.444941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f0c59-60e2-4c8d-a869-a4317b7fbe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.465577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ee7f4-c273-4bb4-8d6f-de48f7972980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.466308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ee7f4-c273-4bb4-8d6f-de48f7972980 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.466603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ee7f4-c273-4bb4-8d6f-de48f7972980 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.466890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ee7f4-c273-4bb4-8d6f-de48f7972980 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.467668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ee7f4-c273-4bb4-8d6f-de48f7972980 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:24.468047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ee7f4-c273-4bb4-8d6f-de48f7972980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.469952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ee7f4-c273-4bb4-8d6f-de48f7972980 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.480415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 74/158] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:24.486098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ee7f4-c273-4bb4-8d6f-de48f7972980 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.494206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-774f0c59-60e2-4c8d-a869-a4317b7fbe96 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:24.495514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-774f0c59-60e2-4c8d-a869-a4317b7fbe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:24.603398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 85/159] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:24.627294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f0c59-60e2-4c8d-a869-a4317b7fbe96 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.638324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ee7f4-c273-4bb4-8d6f-de48f7972980 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.677674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2958a9f-7803-4957-968d-e84b130bda66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.678582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958a9f-7803-4957-968d-e84b130bda66 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.678870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958a9f-7803-4957-968d-e84b130bda66 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.679147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2958a9f-7803-4957-968d-e84b130bda66 None admin] PATH_INFO: `/v3/users/34ed119cc247421babe93929a9f89aa8` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.680435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2958a9f-7803-4957-968d-e84b130bda66 None admin] RBAC: Authorizing `identity:get_user(user_id=34ed119cc247421babe93929a9f89aa8)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.681923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2958a9f-7803-4957-968d-e84b130bda66 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.683601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 75/160] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/users/34ed119cc247421babe93929a9f89aa8 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:24.684810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ab3a3-85ed-499e-b342-b6dc7a0f8edd None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.685098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ab3a3-85ed-499e-b342-b6dc7a0f8edd None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.685740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77ab3a3-85ed-499e-b342-b6dc7a0f8edd None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.687586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 76/161] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:24.692092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ab3a3-85ed-499e-b342-b6dc7a0f8edd None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.745747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f0c59-60e2-4c8d-a869-a4317b7fbe96 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.759104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:24.768279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:24.785614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bcb531-a2f5-4d82-8d45-e7ad83221be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.786482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcb531-a2f5-4d82-8d45-e7ad83221be5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.786763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcb531-a2f5-4d82-8d45-e7ad83221be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.787036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bcb531-a2f5-4d82-8d45-e7ad83221be5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.797810 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bcb531-a2f5-4d82-8d45-e7ad83221be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f3bcb531-a2f5-4d82-8d45-e7ad83221be5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:24.806198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:24.807064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:24.807812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 86/162] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:24.811881 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f91ac-a7ee-46f9-bd27-aa12af2aa51c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.811881 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f91ac-a7ee-46f9-bd27-aa12af2aa51c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.811881 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f91ac-a7ee-46f9-bd27-aa12af2aa51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.823133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77ab3a3-85ed-499e-b342-b6dc7a0f8edd None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:24.828850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f15f91ac-a7ee-46f9-bd27-aa12af2aa51c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:24.830023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f15f91ac-a7ee-46f9-bd27-aa12af2aa51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:24.859811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648390d-5f8b-44bc-b4df-e7bb5dfdb2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:24.860468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648390d-5f8b-44bc-b4df-e7bb5dfdb2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.860760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648390d-5f8b-44bc-b4df-e7bb5dfdb2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.861038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648390d-5f8b-44bc-b4df-e7bb5dfdb2b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.897310 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 87/163] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:24.903514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc53b-86cd-49d9-b456-6d426c7f1c5d None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:24.903959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc53b-86cd-49d9-b456-6d426c7f1c5d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:24.904240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bc53b-86cd-49d9-b456-6d426c7f1c5d None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:24.905674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 88/164] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:24.906272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc53b-86cd-49d9-b456-6d426c7f1c5d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:24.931554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648390d-5f8b-44bc-b4df-e7bb5dfdb2b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:24.933257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648390d-5f8b-44bc-b4df-e7bb5dfdb2b9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:24.979285 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.009680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bc53b-86cd-49d9-b456-6d426c7f1c5d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.020288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.032850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 77/165] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:25.034137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20e67f-4e34-4e67-9cf3-760bbf7dbb34 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.034423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20e67f-4e34-4e67-9cf3-760bbf7dbb34 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.034699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20e67f-4e34-4e67-9cf3-760bbf7dbb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.048377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db9eaa-0bbf-4b55-a706-4bd2f19506f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.049038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db9eaa-0bbf-4b55-a706-4bd2f19506f7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.049317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db9eaa-0bbf-4b55-a706-4bd2f19506f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.049587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db9eaa-0bbf-4b55-a706-4bd2f19506f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.050054 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1e20e67f-4e34-4e67-9cf3-760bbf7dbb34 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:25.050419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db9eaa-0bbf-4b55-a706-4bd2f19506f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:25.050721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db9eaa-0bbf-4b55-a706-4bd2f19506f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.051257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1e20e67f-4e34-4e67-9cf3-760bbf7dbb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:25.052118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db9eaa-0bbf-4b55-a706-4bd2f19506f7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.061366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 89/166] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.062896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db9eaa-0bbf-4b55-a706-4bd2f19506f7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.120259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 78/167] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:25.121018 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20e67f-4e34-4e67-9cf3-760bbf7dbb34 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.160267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db9eaa-0bbf-4b55-a706-4bd2f19506f7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.193293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939592-8100-4f92-aa0d-4f1c9a05fde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.194108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939592-8100-4f92-aa0d-4f1c9a05fde2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.194386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939592-8100-4f92-aa0d-4f1c9a05fde2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.194667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939592-8100-4f92-aa0d-4f1c9a05fde2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.204428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14939592-8100-4f92-aa0d-4f1c9a05fde2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-14939592-8100-4f92-aa0d-4f1c9a05fde2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:25.212241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:25.213088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:25.213936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 90/168] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:25.214610 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939592-8100-4f92-aa0d-4f1c9a05fde2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.218828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.241529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20e67f-4e34-4e67-9cf3-760bbf7dbb34 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.245173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.274865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640b844-70c5-4152-9163-08984c4f7532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.275724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640b844-70c5-4152-9163-08984c4f7532 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.276010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640b844-70c5-4152-9163-08984c4f7532 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.276289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640b844-70c5-4152-9163-08984c4f7532 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.277467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640b844-70c5-4152-9163-08984c4f7532 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.278974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e640b844-70c5-4152-9163-08984c4f7532 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.280679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 79/169] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.283803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640b844-70c5-4152-9163-08984c4f7532 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.313089 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939592-8100-4f92-aa0d-4f1c9a05fde2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.345224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339df394-b446-4ab2-ac9a-48286d3b43f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.346104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339df394-b446-4ab2-ac9a-48286d3b43f4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.346398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339df394-b446-4ab2-ac9a-48286d3b43f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.346669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339df394-b446-4ab2-ac9a-48286d3b43f4 None admin] PATH_INFO: `/v3/users/0da5290c3d8842fca5dbee4c24dea4b3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.347843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339df394-b446-4ab2-ac9a-48286d3b43f4 None admin] RBAC: Authorizing `identity:get_user(user_id=0da5290c3d8842fca5dbee4c24dea4b3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.349853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339df394-b446-4ab2-ac9a-48286d3b43f4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.351664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 91/170] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/users/0da5290c3d8842fca5dbee4c24dea4b3 => generated 289 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.352232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339df394-b446-4ab2-ac9a-48286d3b43f4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.387225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640b844-70c5-4152-9163-08984c4f7532 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.420433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c80ee-fd27-411e-8aad-1c8706186b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.421250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c80ee-fd27-411e-8aad-1c8706186b0b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.421534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c80ee-fd27-411e-8aad-1c8706186b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.421811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c80ee-fd27-411e-8aad-1c8706186b0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.423083 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c80ee-fd27-411e-8aad-1c8706186b0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.424539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c80ee-fd27-411e-8aad-1c8706186b0b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.426178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 80/171] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.426178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c80ee-fd27-411e-8aad-1c8706186b0b None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.441976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.453006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.456299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339df394-b446-4ab2-ac9a-48286d3b43f4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.489848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce92fb3-4bcc-4cb1-8deb-de8f6ff1814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.490538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92fb3-4bcc-4cb1-8deb-de8f6ff1814f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.490820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92fb3-4bcc-4cb1-8deb-de8f6ff1814f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.491152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce92fb3-4bcc-4cb1-8deb-de8f6ff1814f None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.491971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce92fb3-4bcc-4cb1-8deb-de8f6ff1814f None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:25.492279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce92fb3-4bcc-4cb1-8deb-de8f6ff1814f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.493657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce92fb3-4bcc-4cb1-8deb-de8f6ff1814f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.501632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 92/172] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.502516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce92fb3-4bcc-4cb1-8deb-de8f6ff1814f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.528986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c80ee-fd27-411e-8aad-1c8706186b0b None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.562773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1b428-70cf-4c28-b4e9-2bc873c3c013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.563424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1b428-70cf-4c28-b4e9-2bc873c3c013 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.563709 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1b428-70cf-4c28-b4e9-2bc873c3c013 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.563984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1b428-70cf-4c28-b4e9-2bc873c3c013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.564810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1b428-70cf-4c28-b4e9-2bc873c3c013 None admin] RBAC: Adding query filter params (role.id=5cb95ca9624d408a80d77ecc45d0c310, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba, user.id=34ed119cc247421babe93929a9f89aa8) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:25.565120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1b428-70cf-4c28-b4e9-2bc873c3c013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.566606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d1b428-70cf-4c28-b4e9-2bc873c3c013 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.572556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 81/173] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/role_assignments?user.id=34ed119cc247421babe93929a9f89aa8&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=5cb95ca9624d408a80d77ecc45d0c310 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.573312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1b428-70cf-4c28-b4e9-2bc873c3c013 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.606408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce92fb3-4bcc-4cb1-8deb-de8f6ff1814f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.646470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6c11d-efa3-4528-9383-3d5679fe114f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.647370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6c11d-efa3-4528-9383-3d5679fe114f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.647649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6c11d-efa3-4528-9383-3d5679fe114f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.647918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f6c11d-efa3-4528-9383-3d5679fe114f None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.649254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6c11d-efa3-4528-9383-3d5679fe114f None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.650901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f6c11d-efa3-4528-9383-3d5679fe114f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.657578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 93/174] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.657578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6c11d-efa3-4528-9383-3d5679fe114f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.673207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.696580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.699854 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1b428-70cf-4c28-b4e9-2bc873c3c013 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.739075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828ecef-ce61-484c-9b4b-b400b340e296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.739789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ecef-ce61-484c-9b4b-b400b340e296 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.740084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ecef-ce61-484c-9b4b-b400b340e296 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.740345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828ecef-ce61-484c-9b4b-b400b340e296 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.741071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828ecef-ce61-484c-9b4b-b400b340e296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.742577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828ecef-ce61-484c-9b4b-b400b340e296 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.772361 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 82/175] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:28:25 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:25.773334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828ecef-ce61-484c-9b4b-b400b340e296 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.785009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f6c11d-efa3-4528-9383-3d5679fe114f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.834383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e893a01-41af-4c77-824d-28ba644aa888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.835562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893a01-41af-4c77-824d-28ba644aa888 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.835991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893a01-41af-4c77-824d-28ba644aa888 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.836414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e893a01-41af-4c77-824d-28ba644aa888 None admin] PATH_INFO: `/v3/users/34ed119cc247421babe93929a9f89aa8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.837782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e893a01-41af-4c77-824d-28ba644aa888 None admin] RBAC: Authorizing `identity:get_user(user_id=34ed119cc247421babe93929a9f89aa8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.839336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e893a01-41af-4c77-824d-28ba644aa888 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.841636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 94/176] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/users/34ed119cc247421babe93929a9f89aa8 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:25.856222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e893a01-41af-4c77-824d-28ba644aa888 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:25.916639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828ecef-ce61-484c-9b4b-b400b340e296 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:25.957126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b72ca-2aca-4701-99ae-88758a249580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:25.958768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b72ca-2aca-4701-99ae-88758a249580 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:25.959045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b72ca-2aca-4701-99ae-88758a249580 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:25.959312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b72ca-2aca-4701-99ae-88758a249580 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/users/0da5290c3d8842fca5dbee4c24dea4b3/roles/e6190de07af44357a40a6be75cf7431c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:25.961377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b72ca-2aca-4701-99ae-88758a249580 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b4124e2ef54662829ffdfde18ae8ba, user_id=0da5290c3d8842fca5dbee4c24dea4b3, role_id=e6190de07af44357a40a6be75cf7431c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:25.962864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b72ca-2aca-4701-99ae-88758a249580 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:25.965372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.975854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:25.980835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 83/177] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:28:25 2022] PUT /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/users/0da5290c3d8842fca5dbee4c24dea4b3/roles/e6190de07af44357a40a6be75cf7431c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:25.982302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e893a01-41af-4c77-824d-28ba644aa888 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.033443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b31b3-ace5-4241-9263-730c05771b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.034104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b31b3-ace5-4241-9263-730c05771b36 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.034395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b31b3-ace5-4241-9263-730c05771b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.034707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b31b3-ace5-4241-9263-730c05771b36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.118544 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b31b3-ace5-4241-9263-730c05771b36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.120091 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2b31b3-ace5-4241-9263-730c05771b36 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.227680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:26.232602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 95/178] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:26.238058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b72ca-2aca-4701-99ae-88758a249580 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.353320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b72ca-2aca-4701-99ae-88758a249580 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.388421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95790b9e-a692-48e3-880b-fd7f9fe0685f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.389297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790b9e-a692-48e3-880b-fd7f9fe0685f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.389578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790b9e-a692-48e3-880b-fd7f9fe0685f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.389846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95790b9e-a692-48e3-880b-fd7f9fe0685f None admin] PATH_INFO: `/v3/projects/21a03eb555254350b3cab25eb7db88e2` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.391091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95790b9e-a692-48e3-880b-fd7f9fe0685f None admin] RBAC: Authorizing `identity:get_project(project_id=21a03eb555254350b3cab25eb7db88e2)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.392669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95790b9e-a692-48e3-880b-fd7f9fe0685f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.394583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 84/179] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:26 2022] GET /identity/v3/projects/21a03eb555254350b3cab25eb7db88e2 => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:26.400723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b31b3-ace5-4241-9263-730c05771b36 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:26.509435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b31b3-ace5-4241-9263-730c05771b36 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:26.557554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a8937-7aae-45c4-863c-b500e1ea38d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:26.558248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a8937-7aae-45c4-863c-b500e1ea38d5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:26.558531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a8937-7aae-45c4-863c-b500e1ea38d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:26.558809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a8937-7aae-45c4-863c-b500e1ea38d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:26.559642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a8937-7aae-45c4-863c-b500e1ea38d5 None admin] RBAC: Adding query filter params (role.id=faabf98abc6d4899b452e792928050ca, scope.project.id=21a03eb555254350b3cab25eb7db88e2, user.id=34ed119cc247421babe93929a9f89aa8) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:26.559950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a8937-7aae-45c4-863c-b500e1ea38d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:26.561408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a8937-7aae-45c4-863c-b500e1ea38d5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:26.571382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 96/180] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:26 2022] GET /identity/v3/role_assignments?user.id=34ed119cc247421babe93929a9f89aa8&scope.project.id=21a03eb555254350b3cab25eb7db88e2&role.id=faabf98abc6d4899b452e792928050ca => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:28.256513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9883-fffb-41d6-b123-c695c99a15d7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.257022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9883-fffb-41d6-b123-c695c99a15d7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.257131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ed9883-fffb-41d6-b123-c695c99a15d7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.258480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 85/181] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:28.263982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4fcc6-d046-4a57-a704-ea8ca6c40bee None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.264395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4fcc6-d046-4a57-a704-ea8ca6c40bee None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.264576 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4fcc6-d046-4a57-a704-ea8ca6c40bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.281895 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-46c4fcc6-d046-4a57-a704-ea8ca6c40bee None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:28.283136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-46c4fcc6-d046-4a57-a704-ea8ca6c40bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:28.347647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.353922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026bb1e-40ab-4187-9e07-5ee40c7e3f10 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.354247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026bb1e-40ab-4187-9e07-5ee40c7e3f10 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.354526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3026bb1e-40ab-4187-9e07-5ee40c7e3f10 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.356037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 86/182] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:28.360830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02457a-da5a-479f-8ead-79234977a323 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.361121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02457a-da5a-479f-8ead-79234977a323 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.361402 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02457a-da5a-479f-8ead-79234977a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.366140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 97/183] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:28.381879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-fa02457a-da5a-479f-8ead-79234977a323 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:28.383352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fa02457a-da5a-479f-8ead-79234977a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:28.389481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4fcc6-d046-4a57-a704-ea8ca6c40bee None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.445362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.459164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 87/184] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:28.463518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14112048-ba24-4d8a-85a3-f36b4143f455 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.463808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14112048-ba24-4d8a-85a3-f36b4143f455 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.464084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14112048-ba24-4d8a-85a3-f36b4143f455 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.465485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 88/185] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:28.470517 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af42c-4337-4a5c-a37e-1a0bf1f1612f None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.470799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af42c-4337-4a5c-a37e-1a0bf1f1612f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.471073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af42c-4337-4a5c-a37e-1a0bf1f1612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.489632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-597af42c-4337-4a5c-a37e-1a0bf1f1612f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:28.490842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-597af42c-4337-4a5c-a37e-1a0bf1f1612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:28.504637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4fcc6-d046-4a57-a704-ea8ca6c40bee None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.549668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7788ccd-11d0-4b3d-b225-3d8c7439a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.551104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7788ccd-11d0-4b3d-b225-3d8c7439a69d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.551574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7788ccd-11d0-4b3d-b225-3d8c7439a69d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.552068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7788ccd-11d0-4b3d-b225-3d8c7439a69d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.565499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7788ccd-11d0-4b3d-b225-3d8c7439a69d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:28.566914 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 89/186] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:28.567632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597af42c-4337-4a5c-a37e-1a0bf1f1612f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f7788ccd-11d0-4b3d-b225-3d8c7439a69d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:28.584178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:28.585075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:28.585825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 98/187] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:28.588289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7788ccd-11d0-4b3d-b225-3d8c7439a69d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.648826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.677685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597af42c-4337-4a5c-a37e-1a0bf1f1612f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.700277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7788ccd-11d0-4b3d-b225-3d8c7439a69d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.702119 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.714653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fcb73-1f5e-4239-b18a-5e596ab94e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.715463 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fcb73-1f5e-4239-b18a-5e596ab94e7e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.715747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fcb73-1f5e-4239-b18a-5e596ab94e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.716024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392fcb73-1f5e-4239-b18a-5e596ab94e7e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.726427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392fcb73-1f5e-4239-b18a-5e596ab94e7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-392fcb73-1f5e-4239-b18a-5e596ab94e7e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:28.734290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:28.735149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:28.735915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 90/188] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:28.736533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fcb73-1f5e-4239-b18a-5e596ab94e7e None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.741356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4214b4-0541-43f2-ba30-e2f01365a124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.742024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4214b4-0541-43f2-ba30-e2f01365a124 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.742323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4214b4-0541-43f2-ba30-e2f01365a124 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.742595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4214b4-0541-43f2-ba30-e2f01365a124 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.743338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4214b4-0541-43f2-ba30-e2f01365a124 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:28.743640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4214b4-0541-43f2-ba30-e2f01365a124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:28.745013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4214b4-0541-43f2-ba30-e2f01365a124 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:28.753449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 99/189] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:28.753449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412f240-7139-402d-878e-7c13eb7622b0 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.753449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412f240-7139-402d-878e-7c13eb7622b0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.753449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412f240-7139-402d-878e-7c13eb7622b0 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.753449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 100/190] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:28.753449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412f240-7139-402d-878e-7c13eb7622b0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.844319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392fcb73-1f5e-4239-b18a-5e596ab94e7e None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.859562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1412f240-7139-402d-878e-7c13eb7622b0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:28.873685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.880056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14be4d-7a7a-48a3-95f2-c042f8570666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.880867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14be4d-7a7a-48a3-95f2-c042f8570666 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.881148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14be4d-7a7a-48a3-95f2-c042f8570666 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.881417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14be4d-7a7a-48a3-95f2-c042f8570666 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.891761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14be4d-7a7a-48a3-95f2-c042f8570666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:28.894764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757acd1-dee6-4931-b1a7-33c09299c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:28.895447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757acd1-dee6-4931-b1a7-33c09299c91e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.895726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757acd1-dee6-4931-b1a7-33c09299c91e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.896007 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757acd1-dee6-4931-b1a7-33c09299c91e None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.896743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757acd1-dee6-4931-b1a7-33c09299c91e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:28.897045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757acd1-dee6-4931-b1a7-33c09299c91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:28.898455 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757acd1-dee6-4931-b1a7-33c09299c91e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-df14be4d-7a7a-48a3-95f2-c042f8570666 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:28.900019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:28.900860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:28.901793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 91/191] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:28.902877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14be4d-7a7a-48a3-95f2-c042f8570666 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:28.910835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 101/192] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:28.912722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e1884-9286-4f0e-9919-e3bcd1f9ad3f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:28.913014 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e1884-9286-4f0e-9919-e3bcd1f9ad3f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:28.913287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e1884-9286-4f0e-9919-e3bcd1f9ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:28.929441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-883e1884-9286-4f0e-9919-e3bcd1f9ad3f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:28.930633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-883e1884-9286-4f0e-9919-e3bcd1f9ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:28.946813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:28.994832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 102/193] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:28.996787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e1884-9286-4f0e-9919-e3bcd1f9ad3f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.003654 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14be4d-7a7a-48a3-95f2-c042f8570666 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.037552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3840b-31e9-45a1-a39b-5adc6fa59dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.038455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3840b-31e9-45a1-a39b-5adc6fa59dff None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.038734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3840b-31e9-45a1-a39b-5adc6fa59dff None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.039004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de3840b-31e9-45a1-a39b-5adc6fa59dff None admin] PATH_INFO: `/v3/users/51a63f2df0684f34a5630c1724af0096` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.052599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3840b-31e9-45a1-a39b-5adc6fa59dff None admin] RBAC: Authorizing `identity:get_user(user_id=51a63f2df0684f34a5630c1724af0096)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.054134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de3840b-31e9-45a1-a39b-5adc6fa59dff None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.055946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 92/194] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/users/51a63f2df0684f34a5630c1724af0096 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:29.056570 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3840b-31e9-45a1-a39b-5adc6fa59dff None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.112782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e1884-9286-4f0e-9919-e3bcd1f9ad3f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.119904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.146364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac8c2-a3e8-48ac-9d5e-90f2c5bd9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.147031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac8c2-a3e8-48ac-9d5e-90f2c5bd9744 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.147313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac8c2-a3e8-48ac-9d5e-90f2c5bd9744 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.147588 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9ac8c2-a3e8-48ac-9d5e-90f2c5bd9744 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.148331 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ac8c2-a3e8-48ac-9d5e-90f2c5bd9744 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:29.148636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ac8c2-a3e8-48ac-9d5e-90f2c5bd9744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.150016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9ac8c2-a3e8-48ac-9d5e-90f2c5bd9744 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.150701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.153563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de3840b-31e9-45a1-a39b-5adc6fa59dff None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.157934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 103/195] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:29.158586 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac8c2-a3e8-48ac-9d5e-90f2c5bd9744 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.189589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abe139-6def-4ffe-b64d-b11c36055ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.190495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abe139-6def-4ffe-b64d-b11c36055ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.190788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abe139-6def-4ffe-b64d-b11c36055ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.191064 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abe139-6def-4ffe-b64d-b11c36055ef1 None admin] PATH_INFO: `/v3/users/0da5290c3d8842fca5dbee4c24dea4b3` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.192267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abe139-6def-4ffe-b64d-b11c36055ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=0da5290c3d8842fca5dbee4c24dea4b3)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.193716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abe139-6def-4ffe-b64d-b11c36055ef1 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.199656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 93/196] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/users/0da5290c3d8842fca5dbee4c24dea4b3 => generated 289 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:29.199656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abe139-6def-4ffe-b64d-b11c36055ef1 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.259859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9ac8c2-a3e8-48ac-9d5e-90f2c5bd9744 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.292844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758636d3-fe2f-4b0f-b953-edda6942dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.293626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758636d3-fe2f-4b0f-b953-edda6942dacc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.293908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758636d3-fe2f-4b0f-b953-edda6942dacc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.294216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758636d3-fe2f-4b0f-b953-edda6942dacc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.294306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abe139-6def-4ffe-b64d-b11c36055ef1 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.295380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758636d3-fe2f-4b0f-b953-edda6942dacc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.296819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758636d3-fe2f-4b0f-b953-edda6942dacc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.298457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 104/197] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:29.299209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758636d3-fe2f-4b0f-b953-edda6942dacc None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.328642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dfc73-677e-4576-8775-f842acec8702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.329292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dfc73-677e-4576-8775-f842acec8702 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.329577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dfc73-677e-4576-8775-f842acec8702 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.329858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906dfc73-677e-4576-8775-f842acec8702 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.337086 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.362668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.396657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dfc73-677e-4576-8775-f842acec8702 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.398048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906dfc73-677e-4576-8775-f842acec8702 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.400943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758636d3-fe2f-4b0f-b953-edda6942dacc None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.433917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b05236-6c86-4d73-b640-70f21da5cc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.434819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b05236-6c86-4d73-b640-70f21da5cc11 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.435106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b05236-6c86-4d73-b640-70f21da5cc11 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.435382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b05236-6c86-4d73-b640-70f21da5cc11 None admin] PATH_INFO: `/v3/users/51a63f2df0684f34a5630c1724af0096` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.436577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b05236-6c86-4d73-b640-70f21da5cc11 None admin] RBAC: Authorizing `identity:get_user(user_id=51a63f2df0684f34a5630c1724af0096)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.438042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b05236-6c86-4d73-b640-70f21da5cc11 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.439685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 105/198] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/users/51a63f2df0684f34a5630c1724af0096 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:29.444288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b05236-6c86-4d73-b640-70f21da5cc11 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.500282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 94/199] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:29.501097 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dfc73-677e-4576-8775-f842acec8702 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.542344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b05236-6c86-4d73-b640-70f21da5cc11 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.544580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.566260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.576003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d87ab1-0a8c-44e9-bcdb-db757afe2cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.576648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d87ab1-0a8c-44e9-bcdb-db757afe2cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.576931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d87ab1-0a8c-44e9-bcdb-db757afe2cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.577209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d87ab1-0a8c-44e9-bcdb-db757afe2cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.597821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906dfc73-677e-4576-8775-f842acec8702 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.631407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3b673-af25-47f2-80c2-b899e157760b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.632062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3b673-af25-47f2-80c2-b899e157760b None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.632341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3b673-af25-47f2-80c2-b899e157760b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.632611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3b673-af25-47f2-80c2-b899e157760b None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.633315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3b673-af25-47f2-80c2-b899e157760b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.634788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3b673-af25-47f2-80c2-b899e157760b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.642775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d87ab1-0a8c-44e9-bcdb-db757afe2cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.644237 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d87ab1-0a8c-44e9-bcdb-db757afe2cd1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.654495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 95/200] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:28:29 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:29.655304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3b673-af25-47f2-80c2-b899e157760b None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.763740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3b673-af25-47f2-80c2-b899e157760b None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.769557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 106/201] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:29.770810 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d87ab1-0a8c-44e9-bcdb-db757afe2cd1 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:29.775564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.794316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:29.808572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1519bf-b1de-4960-ae33-3defb7fb44e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.809229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1519bf-b1de-4960-ae33-3defb7fb44e5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.809526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1519bf-b1de-4960-ae33-3defb7fb44e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.809790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1519bf-b1de-4960-ae33-3defb7fb44e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.890965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1519bf-b1de-4960-ae33-3defb7fb44e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.892784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1519bf-b1de-4960-ae33-3defb7fb44e5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.894135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d87ab1-0a8c-44e9-bcdb-db757afe2cd1 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:29.941542 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839e36-72ce-4ed6-92cb-912d9029fa0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:29.943365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839e36-72ce-4ed6-92cb-912d9029fa0c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:29.943365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839e36-72ce-4ed6-92cb-912d9029fa0c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:29.943365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30839e36-72ce-4ed6-92cb-912d9029fa0c None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:29.946306 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839e36-72ce-4ed6-92cb-912d9029fa0c None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:29.946806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30839e36-72ce-4ed6-92cb-912d9029fa0c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:29.948638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 107/202] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:29.949514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839e36-72ce-4ed6-92cb-912d9029fa0c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.020735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 96/203] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:30.021980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1519bf-b1de-4960-ae33-3defb7fb44e5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.040580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.058468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.079186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30839e36-72ce-4ed6-92cb-912d9029fa0c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.125558 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab1882-b693-4c26-bfba-7d161a88cdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.126463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab1882-b693-4c26-bfba-7d161a88cdec None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.126908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab1882-b693-4c26-bfba-7d161a88cdec None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.127186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab1882-b693-4c26-bfba-7d161a88cdec None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.129022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab1882-b693-4c26-bfba-7d161a88cdec None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.131103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1519bf-b1de-4960-ae33-3defb7fb44e5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.131221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab1882-b693-4c26-bfba-7d161a88cdec None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.133304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 108/204] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:29 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:30.140196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab1882-b693-4c26-bfba-7d161a88cdec None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.166531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d3304-e708-45a4-a68a-d10389dc2d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.167374 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d3304-e708-45a4-a68a-d10389dc2d61 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.167756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d3304-e708-45a4-a68a-d10389dc2d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.168135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d3304-e708-45a4-a68a-d10389dc2d61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.169074 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d3304-e708-45a4-a68a-d10389dc2d61 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=19b8d221fd644566a8af166462a8a3db, user.id=51a63f2df0684f34a5630c1724af0096) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:30.169487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d3304-e708-45a4-a68a-d10389dc2d61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.171074 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d3304-e708-45a4-a68a-d10389dc2d61 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.179202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 97/205] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/role_assignments?user.id=51a63f2df0684f34a5630c1724af0096&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=308d9785120a49079e02659953a2b033 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:30.179826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d3304-e708-45a4-a68a-d10389dc2d61 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.327776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab1882-b693-4c26-bfba-7d161a88cdec None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.359368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.385831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d3304-e708-45a4-a68a-d10389dc2d61 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.402330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de32c-0cec-4194-b5fb-186d3e9a1b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.404307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de32c-0cec-4194-b5fb-186d3e9a1b6c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.404799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de32c-0cec-4194-b5fb-186d3e9a1b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.405276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522de32c-0cec-4194-b5fb-186d3e9a1b6c None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.408440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522de32c-0cec-4194-b5fb-186d3e9a1b6c None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.410248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522de32c-0cec-4194-b5fb-186d3e9a1b6c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.412350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 109/206] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:30.419171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de32c-0cec-4194-b5fb-186d3e9a1b6c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:30.430813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:30.464982 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d16f6c-733a-4630-bdf8-d5cbb1ecada4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.466877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d16f6c-733a-4630-bdf8-d5cbb1ecada4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.467164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d16f6c-733a-4630-bdf8-d5cbb1ecada4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.467445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d16f6c-733a-4630-bdf8-d5cbb1ecada4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.468298 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d16f6c-733a-4630-bdf8-d5cbb1ecada4 None admin] RBAC: Adding query filter params (role.id=e6190de07af44357a40a6be75cf7431c, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba, user.id=0da5290c3d8842fca5dbee4c24dea4b3) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:30.468612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d16f6c-733a-4630-bdf8-d5cbb1ecada4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.470369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d16f6c-733a-4630-bdf8-d5cbb1ecada4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.487791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 98/207] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/role_assignments?user.id=0da5290c3d8842fca5dbee4c24dea4b3&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=e6190de07af44357a40a6be75cf7431c => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:30.563534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522de32c-0cec-4194-b5fb-186d3e9a1b6c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:30.620853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea83042-4381-47d3-abe7-a612dea6aa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:30.621528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83042-4381-47d3-abe7-a612dea6aa76 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:30.621729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83042-4381-47d3-abe7-a612dea6aa76 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:30.622006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83042-4381-47d3-abe7-a612dea6aa76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:30.622942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea83042-4381-47d3-abe7-a612dea6aa76 None admin] RBAC: Adding query filter params (role.id=5cb95ca9624d408a80d77ecc45d0c310, scope.project.id=19b8d221fd644566a8af166462a8a3db, user.id=51a63f2df0684f34a5630c1724af0096) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:30.623270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea83042-4381-47d3-abe7-a612dea6aa76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:30.624825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea83042-4381-47d3-abe7-a612dea6aa76 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:30.635022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 110/208] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:30 2022] GET /identity/v3/role_assignments?user.id=51a63f2df0684f34a5630c1724af0096&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=5cb95ca9624d408a80d77ecc45d0c310 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:32.024649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d968a-5f73-4966-8450-5216a3a95828 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.025151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d968a-5f73-4966-8450-5216a3a95828 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.025224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d968a-5f73-4966-8450-5216a3a95828 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.026624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 99/209] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:32.032023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17a57-1536-4106-9878-71b8a659f978 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.032438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17a57-1536-4106-9878-71b8a659f978 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.032623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf17a57-1536-4106-9878-71b8a659f978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.049647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-acf17a57-1536-4106-9878-71b8a659f978 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:32.050878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-acf17a57-1536-4106-9878-71b8a659f978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:32.119036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 111/210] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:32.142404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d968a-5f73-4966-8450-5216a3a95828 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.167971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e106-6fb2-4675-848c-53468b8eeddd None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.168273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e106-6fb2-4675-848c-53468b8eeddd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.168632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14e106-6fb2-4675-848c-53468b8eeddd None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.170296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 112/211] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:32.176097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bd333-03af-4407-a06f-6c775296d11e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.177033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bd333-03af-4407-a06f-6c775296d11e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.177413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6bd333-03af-4407-a06f-6c775296d11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.182950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:32.198160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ab6bd333-03af-4407-a06f-6c775296d11e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:32.199580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ab6bd333-03af-4407-a06f-6c775296d11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:32.267669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d968a-5f73-4966-8450-5216a3a95828 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.276912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 113/212] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:32.300665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bd333-03af-4407-a06f-6c775296d11e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.304829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a6ad8-71a0-4771-9507-6e0d36a4b28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.305637 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a6ad8-71a0-4771-9507-6e0d36a4b28c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.305918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a6ad8-71a0-4771-9507-6e0d36a4b28c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.306218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a6ad8-71a0-4771-9507-6e0d36a4b28c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.317227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a6ad8-71a0-4771-9507-6e0d36a4b28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-d40a6ad8-71a0-4771-9507-6e0d36a4b28c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:32.325408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:32.326290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:32.327524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 100/213] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:32.333481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a6ad8-71a0-4771-9507-6e0d36a4b28c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.353569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:32.408688 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6bd333-03af-4407-a06f-6c775296d11e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.444660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf356153-3a50-4cd0-91d3-06985b9d8a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.445500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356153-3a50-4cd0-91d3-06985b9d8a37 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.445789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356153-3a50-4cd0-91d3-06985b9d8a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.446070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf356153-3a50-4cd0-91d3-06985b9d8a37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.447315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf356153-3a50-4cd0-91d3-06985b9d8a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:32.448798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf356153-3a50-4cd0-91d3-06985b9d8a37 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:32.450676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 114/214] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:32.451047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:32.456135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf356153-3a50-4cd0-91d3-06985b9d8a37 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.469167 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a6ad8-71a0-4771-9507-6e0d36a4b28c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.504478 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48501556-3f00-45fc-a566-f09cfa5b7785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.505978 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48501556-3f00-45fc-a566-f09cfa5b7785 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.506458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48501556-3f00-45fc-a566-f09cfa5b7785 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.506909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48501556-3f00-45fc-a566-f09cfa5b7785 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.507863 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48501556-3f00-45fc-a566-f09cfa5b7785 None admin] RBAC: Adding query filter params (name=member) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:32.508396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48501556-3f00-45fc-a566-f09cfa5b7785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:32.510064 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48501556-3f00-45fc-a566-f09cfa5b7785 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:32.519641 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 101/215] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:32.531483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48501556-3f00-45fc-a566-f09cfa5b7785 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.564600 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf356153-3a50-4cd0-91d3-06985b9d8a37 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.601805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547423e-1e6f-4e22-bf2c-d1e173459832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.602523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547423e-1e6f-4e22-bf2c-d1e173459832 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.602803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547423e-1e6f-4e22-bf2c-d1e173459832 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.603073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547423e-1e6f-4e22-bf2c-d1e173459832 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.603874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547423e-1e6f-4e22-bf2c-d1e173459832 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:32.605407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547423e-1e6f-4e22-bf2c-d1e173459832 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:32.613720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:32.625498 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 115/216] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:28:32 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:32.630327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72db3e-5118-425b-8ffd-2d42bccb93fd None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.630327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72db3e-5118-425b-8ffd-2d42bccb93fd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.630327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72db3e-5118-425b-8ffd-2d42bccb93fd None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.630327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 116/217] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:32.635871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addee6ff-e345-4403-8c6e-90b1e990c19d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.636330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addee6ff-e345-4403-8c6e-90b1e990c19d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.636661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addee6ff-e345-4403-8c6e-90b1e990c19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.650695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48501556-3f00-45fc-a566-f09cfa5b7785 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.656429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-addee6ff-e345-4403-8c6e-90b1e990c19d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:32.657705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-addee6ff-e345-4403-8c6e-90b1e990c19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:32.690289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d418b-6ef6-4ca6-b5c8-9ee13f56cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.691370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d418b-6ef6-4ca6-b5c8-9ee13f56cfba None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.691887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d418b-6ef6-4ca6-b5c8-9ee13f56cfba None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.692773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d418b-6ef6-4ca6-b5c8-9ee13f56cfba None admin] PATH_INFO: `/v3/users/d4f6b00806ec4f8cbff275de6cd892b3` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.712661 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d418b-6ef6-4ca6-b5c8-9ee13f56cfba None admin] RBAC: Authorizing `identity:get_user(user_id=d4f6b00806ec4f8cbff275de6cd892b3)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:32.714584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d418b-6ef6-4ca6-b5c8-9ee13f56cfba None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:32.717431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 102/218] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:32 2022] GET /identity/v3/users/d4f6b00806ec4f8cbff275de6cd892b3 => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:32.723011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d418b-6ef6-4ca6-b5c8-9ee13f56cfba None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.725360 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:32.747535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 117/219] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:32.773209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addee6ff-e345-4403-8c6e-90b1e990c19d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:32.865882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d418b-6ef6-4ca6-b5c8-9ee13f56cfba None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.911026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:32.912657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addee6ff-e345-4403-8c6e-90b1e990c19d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:32.920718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204e0fc9-fbc2-415f-83e8-f60b884fcc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.921055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e0fc9-fbc2-415f-83e8-f60b884fcc07 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.921428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e0fc9-fbc2-415f-83e8-f60b884fcc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.921716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204e0fc9-fbc2-415f-83e8-f60b884fcc07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.957598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446abbe-0193-4372-932b-386016b579d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:32.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446abbe-0193-4372-932b-386016b579d5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:32.959286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446abbe-0193-4372-932b-386016b579d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:32.959752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446abbe-0193-4372-932b-386016b579d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:32.972954 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446abbe-0193-4372-932b-386016b579d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c446abbe-0193-4372-932b-386016b579d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:32.982403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:32.983251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:32.984005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:32.986709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 118/220] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:28:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:32.992891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446abbe-0193-4372-932b-386016b579d5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:33.016469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e0fc9-fbc2-415f-83e8-f60b884fcc07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:33.018180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204e0fc9-fbc2-415f-83e8-f60b884fcc07 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:33.058462 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:33.122615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446abbe-0193-4372-932b-386016b579d5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:33.147219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 103/221] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:33.148570 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e00ed-ba6a-47c9-b528-6eae6fbff272 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.148859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e00ed-ba6a-47c9-b528-6eae6fbff272 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.149137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e00ed-ba6a-47c9-b528-6eae6fbff272 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.153725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 104/222] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:33.155078 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e00ed-ba6a-47c9-b528-6eae6fbff272 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:33.172715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4bc33-d8d7-4953-9637-8a1dd0be14d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:33.173391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4bc33-d8d7-4953-9637-8a1dd0be14d3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.173680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4bc33-d8d7-4953-9637-8a1dd0be14d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.173961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4bc33-d8d7-4953-9637-8a1dd0be14d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.174767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4bc33-d8d7-4953-9637-8a1dd0be14d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:33.175077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4bc33-d8d7-4953-9637-8a1dd0be14d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:33.176550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4bc33-d8d7-4953-9637-8a1dd0be14d3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:33.190031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 119/223] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:33.191061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:33.192581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a030-ec87-45b6-9845-925f54ae9a0d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.192870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a030-ec87-45b6-9845-925f54ae9a0d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.193152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7973a030-ec87-45b6-9845-925f54ae9a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.213400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7973a030-ec87-45b6-9845-925f54ae9a0d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:33.214655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7973a030-ec87-45b6-9845-925f54ae9a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:33.285235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e00ed-ba6a-47c9-b528-6eae6fbff272 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:33.291636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 120/224] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:33.292607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973a030-ec87-45b6-9845-925f54ae9a0d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:33.332559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6b549-1ebe-4614-9621-60ea3187346f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:33.333766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6b549-1ebe-4614-9621-60ea3187346f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.334266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6b549-1ebe-4614-9621-60ea3187346f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.334723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6b549-1ebe-4614-9621-60ea3187346f None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.336121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6b549-1ebe-4614-9621-60ea3187346f None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:33.337346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:33.340355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6b549-1ebe-4614-9621-60ea3187346f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:33.343747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 105/225] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:33 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:33.345194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6b549-1ebe-4614-9621-60ea3187346f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:33.406256 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7973a030-ec87-45b6-9845-925f54ae9a0d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:33.445414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54018029-f34e-42a4-89fd-9781b8e5845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:33.446660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54018029-f34e-42a4-89fd-9781b8e5845f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.446896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54018029-f34e-42a4-89fd-9781b8e5845f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.447250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54018029-f34e-42a4-89fd-9781b8e5845f None admin] PATH_INFO: `/v3/users/51a63f2df0684f34a5630c1724af0096` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.448523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54018029-f34e-42a4-89fd-9781b8e5845f None admin] RBAC: Authorizing `identity:get_user(user_id=51a63f2df0684f34a5630c1724af0096)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:33.450218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54018029-f34e-42a4-89fd-9781b8e5845f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:33.452390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 121/226] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:33 2022] GET /identity/v3/users/51a63f2df0684f34a5630c1724af0096 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:33.453372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54018029-f34e-42a4-89fd-9781b8e5845f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:33.477475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:33.480024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6b549-1ebe-4614-9621-60ea3187346f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:33.523192 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aeb22-ee9f-4911-a585-578757606373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:33.524393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aeb22-ee9f-4911-a585-578757606373 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.524946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aeb22-ee9f-4911-a585-578757606373 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.525421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aeb22-ee9f-4911-a585-578757606373 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.537775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aeb22-ee9f-4911-a585-578757606373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-480aeb22-ee9f-4911-a585-578757606373 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:33.546894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:33.547771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:33.548550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:33.551152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 106/227] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:33.552882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aeb22-ee9f-4911-a585-578757606373 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:33.573978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54018029-f34e-42a4-89fd-9781b8e5845f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:33.581539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:33.612288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29552590-1f00-4794-b5b5-47d5300792eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:33.612948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29552590-1f00-4794-b5b5-47d5300792eb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.613233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29552590-1f00-4794-b5b5-47d5300792eb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.613511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29552590-1f00-4794-b5b5-47d5300792eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.614507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29552590-1f00-4794-b5b5-47d5300792eb None admin] RBAC: Adding query filter params (role.id=faabf98abc6d4899b452e792928050ca, scope.project.id=19b8d221fd644566a8af166462a8a3db, user.id=d4f6b00806ec4f8cbff275de6cd892b3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:33.614737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29552590-1f00-4794-b5b5-47d5300792eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:33.616187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29552590-1f00-4794-b5b5-47d5300792eb None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:33.622414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 122/228] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:33 2022] GET /identity/v3/role_assignments?user.id=d4f6b00806ec4f8cbff275de6cd892b3&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=faabf98abc6d4899b452e792928050ca => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:33.623321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29552590-1f00-4794-b5b5-47d5300792eb None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:33.698844 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aeb22-ee9f-4911-a585-578757606373 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:33.746195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29552590-1f00-4794-b5b5-47d5300792eb None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:33.767481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879e6d6-f37b-4482-8d7b-badde22d7dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:33.768810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879e6d6-f37b-4482-8d7b-badde22d7dbe None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.769308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879e6d6-f37b-4482-8d7b-badde22d7dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.769797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879e6d6-f37b-4482-8d7b-badde22d7dbe None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.772098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879e6d6-f37b-4482-8d7b-badde22d7dbe None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:33.773909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879e6d6-f37b-4482-8d7b-badde22d7dbe None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:33.776225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 107/229] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:33 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:33.782795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879e6d6-f37b-4482-8d7b-badde22d7dbe None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:33.783658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05ced0-8a22-4155-97c5-40f4661194b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:33.784338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ced0-8a22-4155-97c5-40f4661194b5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.784626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ced0-8a22-4155-97c5-40f4661194b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.784905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d05ced0-8a22-4155-97c5-40f4661194b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.785668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05ced0-8a22-4155-97c5-40f4661194b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:33.786039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05ced0-8a22-4155-97c5-40f4661194b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:33.787592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d05ced0-8a22-4155-97c5-40f4661194b5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:33.796773 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 123/230] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:33.803290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05ced0-8a22-4155-97c5-40f4661194b5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:33.823816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:33.860641 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:33.909594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879e6d6-f37b-4482-8d7b-badde22d7dbe None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:33.947429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85d2a-d309-4940-987f-703524022bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:33.948797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85d2a-d309-4940-987f-703524022bcb None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:33.949287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85d2a-d309-4940-987f-703524022bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:33.949786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc85d2a-d309-4940-987f-703524022bcb None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db/users/51a63f2df0684f34a5630c1724af0096/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:33.952219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85d2a-d309-4940-987f-703524022bcb None admin] RBAC: Authorizing `identity:create_grant(project_id=19b8d221fd644566a8af166462a8a3db, user_id=51a63f2df0684f34a5630c1724af0096, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:33.954024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc85d2a-d309-4940-987f-703524022bcb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:33.970812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 108/231] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:28:33 2022] PUT /identity/v3/projects/19b8d221fd644566a8af166462a8a3db/users/51a63f2df0684f34a5630c1724af0096/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:28:33.972358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d05ced0-8a22-4155-97c5-40f4661194b5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:34.018282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f2d29-217e-44d2-8005-7be8e263e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:34.019107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f2d29-217e-44d2-8005-7be8e263e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.019403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f2d29-217e-44d2-8005-7be8e263e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.019668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f2d29-217e-44d2-8005-7be8e263e3e0 None admin] PATH_INFO: `/v3/users/51a63f2df0684f34a5630c1724af0096` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.020984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f2d29-217e-44d2-8005-7be8e263e3e0 None admin] RBAC: Authorizing `identity:get_user(user_id=51a63f2df0684f34a5630c1724af0096)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:34.023038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f2d29-217e-44d2-8005-7be8e263e3e0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:34.025041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 124/232] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:33 2022] GET /identity/v3/users/51a63f2df0684f34a5630c1724af0096 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:34.030361 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85d2a-d309-4940-987f-703524022bcb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:34.138944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:34.157134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc85d2a-d309-4940-987f-703524022bcb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:34.200618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480aa531-9c43-4474-b194-1a9050a7f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:34.201504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aa531-9c43-4474-b194-1a9050a7f111 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.201790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aa531-9c43-4474-b194-1a9050a7f111 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.202071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480aa531-9c43-4474-b194-1a9050a7f111 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.203370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aa531-9c43-4474-b194-1a9050a7f111 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:34.204833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480aa531-9c43-4474-b194-1a9050a7f111 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:34.206636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 109/233] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:34 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:34.212985 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f2d29-217e-44d2-8005-7be8e263e3e0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:34.319756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:34.323099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f2d29-217e-44d2-8005-7be8e263e3e0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:34.366034 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425834e-a4f2-4961-9830-bdaa170d9a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:34.366978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425834e-a4f2-4961-9830-bdaa170d9a13 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:34.367262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425834e-a4f2-4961-9830-bdaa170d9a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:34.367540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425834e-a4f2-4961-9830-bdaa170d9a13 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db/users/51a63f2df0684f34a5630c1724af0096/roles/5cb95ca9624d408a80d77ecc45d0c310` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:34.370073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425834e-a4f2-4961-9830-bdaa170d9a13 None admin] RBAC: Authorizing `identity:create_grant(project_id=19b8d221fd644566a8af166462a8a3db, user_id=51a63f2df0684f34a5630c1724af0096, role_id=5cb95ca9624d408a80d77ecc45d0c310)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:34.371673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425834e-a4f2-4961-9830-bdaa170d9a13 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:34.392595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 125/234] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:28:34 2022] PUT /identity/v3/projects/19b8d221fd644566a8af166462a8a3db/users/51a63f2df0684f34a5630c1724af0096/roles/5cb95ca9624d408a80d77ecc45d0c310 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:35.390620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90b61-b370-4585-a4ef-09e75d345900 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.391134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90b61-b370-4585-a4ef-09e75d345900 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.391207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e90b61-b370-4585-a4ef-09e75d345900 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.392553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 110/235] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:35.398168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810bdb1-c190-43ed-8a9f-8cbaed693fb0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.398593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810bdb1-c190-43ed-8a9f-8cbaed693fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.398766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5810bdb1-c190-43ed-8a9f-8cbaed693fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.422403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5810bdb1-c190-43ed-8a9f-8cbaed693fb0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:35.423603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5810bdb1-c190-43ed-8a9f-8cbaed693fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:35.509366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 126/236] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:35.544859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e90b61-b370-4585-a4ef-09e75d345900 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:35.671812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e90b61-b370-4585-a4ef-09e75d345900 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:35.716937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34252715-4b4b-4c74-b977-5112732154c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:35.717747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252715-4b4b-4c74-b977-5112732154c9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.718029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252715-4b4b-4c74-b977-5112732154c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.718331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252715-4b4b-4c74-b977-5112732154c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.729448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34252715-4b4b-4c74-b977-5112732154c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:35.737921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690ca8-e73a-4479-8c6d-c97ffff6df06 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.738498 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690ca8-e73a-4479-8c6d-c97ffff6df06 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.739521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9690ca8-e73a-4479-8c6d-c97ffff6df06 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.741106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 127/237] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-34252715-4b4b-4c74-b977-5112732154c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:35.744179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:35.745241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:35.745993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 111/238] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:35.749237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712bc2d-cc20-4aec-93eb-5218025749a7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.749344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9690ca8-e73a-4479-8c6d-c97ffff6df06 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:35.749815 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712bc2d-cc20-4aec-93eb-5218025749a7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.750325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712bc2d-cc20-4aec-93eb-5218025749a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.787142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e712bc2d-cc20-4aec-93eb-5218025749a7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:35.788894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e712bc2d-cc20-4aec-93eb-5218025749a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:35.810476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:35.918441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:35.935620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 112/239] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:35.935952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9690ca8-e73a-4479-8c6d-c97ffff6df06 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:35.972144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa0faa-3021-4262-9dee-e48a93bd7fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:35.972460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712bc2d-cc20-4aec-93eb-5218025749a7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:35.972869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0faa-3021-4262-9dee-e48a93bd7fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:35.973157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0faa-3021-4262-9dee-e48a93bd7fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:35.974097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0faa-3021-4262-9dee-e48a93bd7fc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:35.974870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa0faa-3021-4262-9dee-e48a93bd7fc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:35.975368 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa0faa-3021-4262-9dee-e48a93bd7fc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:35.976831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa0faa-3021-4262-9dee-e48a93bd7fc2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:35.987401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 128/240] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:35.996478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa0faa-3021-4262-9dee-e48a93bd7fc2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.135123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712bc2d-cc20-4aec-93eb-5218025749a7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.175544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dbdb7-4c5e-4173-9995-0629e973c558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.177352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dbdb7-4c5e-4173-9995-0629e973c558 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.177985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dbdb7-4c5e-4173-9995-0629e973c558 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.180030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa0faa-3021-4262-9dee-e48a93bd7fc2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.180516 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dbdb7-4c5e-4173-9995-0629e973c558 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.183377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dbdb7-4c5e-4173-9995-0629e973c558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.185035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84dbdb7-4c5e-4173-9995-0629e973c558 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.187743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 113/241] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:36.193897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dbdb7-4c5e-4173-9995-0629e973c558 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.223332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.224800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c375-ccc3-4ba0-9502-e2f5d8c1bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.226056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c375-ccc3-4ba0-9502-e2f5d8c1bf0b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.226560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c375-ccc3-4ba0-9502-e2f5d8c1bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.227367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8217c375-ccc3-4ba0-9502-e2f5d8c1bf0b None admin] PATH_INFO: `/v3/users/246094af068344c5bd2982ddaed2cb1f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.241860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c375-ccc3-4ba0-9502-e2f5d8c1bf0b None admin] RBAC: Authorizing `identity:get_user(user_id=246094af068344c5bd2982ddaed2cb1f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.243986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8217c375-ccc3-4ba0-9502-e2f5d8c1bf0b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.245920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 129/242] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:35 2022] GET /identity/v3/users/246094af068344c5bd2982ddaed2cb1f => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:36.251405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c375-ccc3-4ba0-9502-e2f5d8c1bf0b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.274443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.359219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dbdb7-4c5e-4173-9995-0629e973c558 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.394627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8217c375-ccc3-4ba0-9502-e2f5d8c1bf0b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.402624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39f31ec-802a-4949-9dd8-cc1352ca350d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.403397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f31ec-802a-4949-9dd8-cc1352ca350d None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.403745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f31ec-802a-4949-9dd8-cc1352ca350d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.404082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39f31ec-802a-4949-9dd8-cc1352ca350d None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.404872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f31ec-802a-4949-9dd8-cc1352ca350d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.406410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39f31ec-802a-4949-9dd8-cc1352ca350d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.430934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 114/243] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:28:36 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:28:36.432371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da08126-69be-492d-8aac-7d0ac6c26bd6 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.432656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da08126-69be-492d-8aac-7d0ac6c26bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.432935 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da08126-69be-492d-8aac-7d0ac6c26bd6 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.436341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 115/244] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:36.443226 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2605c4-bb1f-468f-bcff-aefd4cf8c0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.445391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dd6d1-e420-4f66-b073-ee502815e37b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.445671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dd6d1-e420-4f66-b073-ee502815e37b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.445942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dd6d1-e420-4f66-b073-ee502815e37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.447464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2605c4-bb1f-468f-bcff-aefd4cf8c0de None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.447842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2605c4-bb1f-468f-bcff-aefd4cf8c0de None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.448117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2605c4-bb1f-468f-bcff-aefd4cf8c0de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.483344 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c29dd6d1-e420-4f66-b073-ee502815e37b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:36.484561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c29dd6d1-e420-4f66-b073-ee502815e37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:36.603579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2605c4-bb1f-468f-bcff-aefd4cf8c0de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.608787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2605c4-bb1f-468f-bcff-aefd4cf8c0de None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.632251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.639702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 116/245] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:36.642099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.666611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dd6d1-e420-4f66-b073-ee502815e37b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.775039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 130/246] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:28:36.780374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2605c4-bb1f-468f-bcff-aefd4cf8c0de None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.800206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dd6d1-e420-4f66-b073-ee502815e37b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.846127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1713f7-79e5-44ec-a9d6-9e0dc1c8cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.847332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1713f7-79e5-44ec-a9d6-9e0dc1c8cf36 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.847827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1713f7-79e5-44ec-a9d6-9e0dc1c8cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.848109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1713f7-79e5-44ec-a9d6-9e0dc1c8cf36 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.861593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1713f7-79e5-44ec-a9d6-9e0dc1c8cf36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-0b1713f7-79e5-44ec-a9d6-9e0dc1c8cf36 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:36.871315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:36.872248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 117/247] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:36.874605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060863b-4611-40e5-b648-ab0c72ab597b None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.875289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060863b-4611-40e5-b648-ab0c72ab597b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.875289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060863b-4611-40e5-b648-ab0c72ab597b None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.875694 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 118/248] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:36.880135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060863b-4611-40e5-b648-ab0c72ab597b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:36.934711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2605c4-bb1f-468f-bcff-aefd4cf8c0de None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:36.952308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.959066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:36.983383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03510fb-cad1-4424-9ada-941c4054436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:36.984266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03510fb-cad1-4424-9ada-941c4054436f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.984527 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03510fb-cad1-4424-9ada-941c4054436f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.984803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03510fb-cad1-4424-9ada-941c4054436f None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:36.986005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03510fb-cad1-4424-9ada-941c4054436f None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:36.987570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03510fb-cad1-4424-9ada-941c4054436f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:36.990035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 131/249] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:36.991629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d13da4-a286-4be2-bb3d-f802271d3fbe None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:36.991909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d13da4-a286-4be2-bb3d-f802271d3fbe None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:36.992179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d13da4-a286-4be2-bb3d-f802271d3fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.009594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f4d13da4-a286-4be2-bb3d-f802271d3fbe None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:37.011025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f4d13da4-a286-4be2-bb3d-f802271d3fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:37.017264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060863b-4611-40e5-b648-ab0c72ab597b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:37.055239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d4cb2-a4e3-4b55-97a8-072c1e83d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:37.056275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d4cb2-a4e3-4b55-97a8-072c1e83d50a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.056896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d4cb2-a4e3-4b55-97a8-072c1e83d50a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.057468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d4cb2-a4e3-4b55-97a8-072c1e83d50a None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.058332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d4cb2-a4e3-4b55-97a8-072c1e83d50a None admin] RBAC: Adding query filter params (name=member) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:37.058712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d4cb2-a4e3-4b55-97a8-072c1e83d50a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:37.060308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4d4cb2-a4e3-4b55-97a8-072c1e83d50a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:37.077682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 119/250] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:37.077682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d4cb2-a4e3-4b55-97a8-072c1e83d50a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:37.094377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 132/251] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:37.095407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d13da4-a286-4be2-bb3d-f802271d3fbe None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:37.222334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d4cb2-a4e3-4b55-97a8-072c1e83d50a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:37.244552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d13da4-a286-4be2-bb3d-f802271d3fbe None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:37.246066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:37.255613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:37.260646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de2e05-fb6f-440d-b1b5-bd0b6251838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:37.261379 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de2e05-fb6f-440d-b1b5-bd0b6251838b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.261774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de2e05-fb6f-440d-b1b5-bd0b6251838b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.262115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de2e05-fb6f-440d-b1b5-bd0b6251838b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.263091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de2e05-fb6f-440d-b1b5-bd0b6251838b None admin] RBAC: Adding query filter params (role.id=e6190de07af44357a40a6be75cf7431c, scope.project.id=19b8d221fd644566a8af166462a8a3db, user.id=246094af068344c5bd2982ddaed2cb1f) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:37.263465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de2e05-fb6f-440d-b1b5-bd0b6251838b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:37.265002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de2e05-fb6f-440d-b1b5-bd0b6251838b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:37.271359 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 120/252] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:37 2022] GET /identity/v3/role_assignments?user.id=246094af068344c5bd2982ddaed2cb1f&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=e6190de07af44357a40a6be75cf7431c => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:37.272265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de2e05-fb6f-440d-b1b5-bd0b6251838b None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:37.287830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef365d-2dec-4676-9546-60c9d34f654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:37.289176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef365d-2dec-4676-9546-60c9d34f654e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.289647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef365d-2dec-4676-9546-60c9d34f654e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.290167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef365d-2dec-4676-9546-60c9d34f654e None admin] PATH_INFO: `/v3/users/d4f6b00806ec4f8cbff275de6cd892b3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.291658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef365d-2dec-4676-9546-60c9d34f654e None admin] RBAC: Authorizing `identity:get_user(user_id=d4f6b00806ec4f8cbff275de6cd892b3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:37.293375 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef365d-2dec-4676-9546-60c9d34f654e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:37.295294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 133/253] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:37 2022] GET /identity/v3/users/d4f6b00806ec4f8cbff275de6cd892b3 => generated 297 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:37.296728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a43727-b12d-49a1-bd97-2b4169cea3f2 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.297194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a43727-b12d-49a1-bd97-2b4169cea3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.297628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a43727-b12d-49a1-bd97-2b4169cea3f2 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.299031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 134/254] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:37.305947 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41135637-bbb5-4cb9-856a-1ae8e888a02e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.306477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41135637-bbb5-4cb9-856a-1ae8e888a02e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.306932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41135637-bbb5-4cb9-856a-1ae8e888a02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.325617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-41135637-bbb5-4cb9-856a-1ae8e888a02e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:37.327194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-41135637-bbb5-4cb9-856a-1ae8e888a02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:37.405395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de2e05-fb6f-440d-b1b5-bd0b6251838b None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:37.427000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 135/255] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:37.435047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41135637-bbb5-4cb9-856a-1ae8e888a02e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:37.475853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f951eac-58fe-4eb4-b4a2-83e4932e697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:37.476680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f951eac-58fe-4eb4-b4a2-83e4932e697d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.476962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f951eac-58fe-4eb4-b4a2-83e4932e697d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.477234 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f951eac-58fe-4eb4-b4a2-83e4932e697d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.502622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f951eac-58fe-4eb4-b4a2-83e4932e697d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-2f951eac-58fe-4eb4-b4a2-83e4932e697d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:37.511627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:37.512486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:37.513245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:37.515552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 121/256] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:28:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:37.516519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f951eac-58fe-4eb4-b4a2-83e4932e697d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:37.599553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:37.619760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41135637-bbb5-4cb9-856a-1ae8e888a02e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:37.633238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:37.684908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be92c3-d598-4e4a-bd8b-2c1346581165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:37.685782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be92c3-d598-4e4a-bd8b-2c1346581165 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.686057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be92c3-d598-4e4a-bd8b-2c1346581165 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.686350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be92c3-d598-4e4a-bd8b-2c1346581165 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.687683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be92c3-d598-4e4a-bd8b-2c1346581165 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:37.689147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be92c3-d598-4e4a-bd8b-2c1346581165 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:37.691030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 136/257] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:37 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:37.695747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be92c3-d598-4e4a-bd8b-2c1346581165 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:37.704357 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f951eac-58fe-4eb4-b4a2-83e4932e697d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:37.809032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be92c3-d598-4e4a-bd8b-2c1346581165 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:37.818311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec85d4-6aa8-44b6-bd7a-0e1e440bec28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:37.819155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec85d4-6aa8-44b6-bd7a-0e1e440bec28 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.819440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec85d4-6aa8-44b6-bd7a-0e1e440bec28 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.819716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eec85d4-6aa8-44b6-bd7a-0e1e440bec28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.854364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47e5f2-ab50-40cd-9c0d-93efe977df00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:37.855370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e5f2-ab50-40cd-9c0d-93efe977df00 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:37.856117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e5f2-ab50-40cd-9c0d-93efe977df00 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:37.856117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47e5f2-ab50-40cd-9c0d-93efe977df00 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:37.862102 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47e5f2-ab50-40cd-9c0d-93efe977df00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:37.862102 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47e5f2-ab50-40cd-9c0d-93efe977df00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:37.862102 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47e5f2-ab50-40cd-9c0d-93efe977df00 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:37.862333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eec85d4-6aa8-44b6-bd7a-0e1e440bec28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-7eec85d4-6aa8-44b6-bd7a-0e1e440bec28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:37.875993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:37.876843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:37.877631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 122/258] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:37.878305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec85d4-6aa8-44b6-bd7a-0e1e440bec28 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:37.883662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 137/259] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:37.884692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47e5f2-ab50-40cd-9c0d-93efe977df00 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:37.954033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:38.086840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47e5f2-ab50-40cd-9c0d-93efe977df00 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.099441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eec85d4-6aa8-44b6-bd7a-0e1e440bec28 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.121704 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:38.163601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffd6d9-b4f9-40df-9134-71b400469fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.164606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b7fb3-88bf-46d8-af23-e226dfe53012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.165745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffd6d9-b4f9-40df-9134-71b400469fad None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.166642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b7fb3-88bf-46d8-af23-e226dfe53012 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.167142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b7fb3-88bf-46d8-af23-e226dfe53012 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.167620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffd6d9-b4f9-40df-9134-71b400469fad None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.168125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b7fb3-88bf-46d8-af23-e226dfe53012 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.168596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffd6d9-b4f9-40df-9134-71b400469fad None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db/users/d4f6b00806ec4f8cbff275de6cd892b3/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.169558 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b7fb3-88bf-46d8-af23-e226dfe53012 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:38.170979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b7fb3-88bf-46d8-af23-e226dfe53012 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.173159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b7fb3-88bf-46d8-af23-e226dfe53012 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.174146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffd6d9-b4f9-40df-9134-71b400469fad None admin] RBAC: Authorizing `identity:create_grant(project_id=19b8d221fd644566a8af166462a8a3db, user_id=d4f6b00806ec4f8cbff275de6cd892b3, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.175811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffd6d9-b4f9-40df-9134-71b400469fad None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.189565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 138/260] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:38.191367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b7fb3-88bf-46d8-af23-e226dfe53012 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:38.202170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 123/261] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:28:37 2022] PUT /identity/v3/projects/19b8d221fd644566a8af166462a8a3db/users/d4f6b00806ec4f8cbff275de6cd892b3/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:38.203175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffd6d9-b4f9-40df-9134-71b400469fad None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:38.417293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:38.424654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b7fb3-88bf-46d8-af23-e226dfe53012 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.430150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffd6d9-b4f9-40df-9134-71b400469fad None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.470185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60abe6-8bc8-4395-a1a3-46142730eb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.470185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60abe6-8bc8-4395-a1a3-46142730eb9c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.470185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60abe6-8bc8-4395-a1a3-46142730eb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.470185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60abe6-8bc8-4395-a1a3-46142730eb9c None admin] PATH_INFO: `/v3/users/51a63f2df0684f34a5630c1724af0096` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.470576 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60abe6-8bc8-4395-a1a3-46142730eb9c None admin] RBAC: Authorizing `identity:get_user(user_id=51a63f2df0684f34a5630c1724af0096)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.470821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc60abe6-8bc8-4395-a1a3-46142730eb9c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.472679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 139/262] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:38 2022] GET /identity/v3/users/51a63f2df0684f34a5630c1724af0096 => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:38.477752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60abe6-8bc8-4395-a1a3-46142730eb9c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:38.478862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82064927-037c-4997-94d7-fc0b6bad35b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.479994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82064927-037c-4997-94d7-fc0b6bad35b9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.480540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82064927-037c-4997-94d7-fc0b6bad35b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.481019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82064927-037c-4997-94d7-fc0b6bad35b9 None admin] PATH_INFO: `/v3/users/51a63f2df0684f34a5630c1724af0096` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.487044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82064927-037c-4997-94d7-fc0b6bad35b9 None admin] RBAC: Authorizing `identity:get_user(user_id=51a63f2df0684f34a5630c1724af0096)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.488819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82064927-037c-4997-94d7-fc0b6bad35b9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.490704 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 124/263] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:38 2022] GET /identity/v3/users/51a63f2df0684f34a5630c1724af0096 => generated 283 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:38.497556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82064927-037c-4997-94d7-fc0b6bad35b9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:38.547003 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:38.662433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82064927-037c-4997-94d7-fc0b6bad35b9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.686975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60abe6-8bc8-4395-a1a3-46142730eb9c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:38.743731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389949c9-0177-4ff0-9749-f2e49790ec7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.744407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389949c9-0177-4ff0-9749-f2e49790ec7b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.744693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389949c9-0177-4ff0-9749-f2e49790ec7b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.744968 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389949c9-0177-4ff0-9749-f2e49790ec7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.751724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b58cc-6fa9-4247-99e1-023fa6e0eacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:38.752655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b58cc-6fa9-4247-99e1-023fa6e0eacb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:38.753132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b58cc-6fa9-4247-99e1-023fa6e0eacb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:38.753609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4b58cc-6fa9-4247-99e1-023fa6e0eacb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:38.808507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:38.856354 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389949c9-0177-4ff0-9749-f2e49790ec7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.857839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389949c9-0177-4ff0-9749-f2e49790ec7b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.865082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b58cc-6fa9-4247-99e1-023fa6e0eacb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:38.866799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4b58cc-6fa9-4247-99e1-023fa6e0eacb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:38.926543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:39.035090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 125/264] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:28:39.041023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b58cc-6fa9-4247-99e1-023fa6e0eacb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.092101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 140/265] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 614 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:28:39.099639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389949c9-0177-4ff0-9749-f2e49790ec7b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.187968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4b58cc-6fa9-4247-99e1-023fa6e0eacb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:39.196125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:39.227227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b6077-c80f-47a5-88f1-9a9ee77ee6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:39.228091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b6077-c80f-47a5-88f1-9a9ee77ee6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.228371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b6077-c80f-47a5-88f1-9a9ee77ee6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.228641 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b6077-c80f-47a5-88f1-9a9ee77ee6b1 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.230537 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b6077-c80f-47a5-88f1-9a9ee77ee6b1 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:39.232004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b6077-c80f-47a5-88f1-9a9ee77ee6b1 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:39.233702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 126/266] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:39.240130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b6077-c80f-47a5-88f1-9a9ee77ee6b1 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.249360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:39.276283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389949c9-0177-4ff0-9749-f2e49790ec7b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:39.346787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12fdfe-e4b4-4da9-a332-c05dbe1f14c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:39.347571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12fdfe-e4b4-4da9-a332-c05dbe1f14c0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.347847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12fdfe-e4b4-4da9-a332-c05dbe1f14c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.348142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12fdfe-e4b4-4da9-a332-c05dbe1f14c0 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.350623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12fdfe-e4b4-4da9-a332-c05dbe1f14c0 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:39.352093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12fdfe-e4b4-4da9-a332-c05dbe1f14c0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:39.353974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 141/267] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:39.363031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12fdfe-e4b4-4da9-a332-c05dbe1f14c0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.441412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b6077-c80f-47a5-88f1-9a9ee77ee6b1 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:39.482535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263f357-2250-460c-9c8c-89381475656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:39.483208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263f357-2250-460c-9c8c-89381475656e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.483488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263f357-2250-460c-9c8c-89381475656e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.483763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263f357-2250-460c-9c8c-89381475656e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.484613 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263f357-2250-460c-9c8c-89381475656e None admin] RBAC: Adding query filter params (role.id=5cb95ca9624d408a80d77ecc45d0c310, scope.project.id=19b8d221fd644566a8af166462a8a3db, user.id=51a63f2df0684f34a5630c1724af0096) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:39.484922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263f357-2250-460c-9c8c-89381475656e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:39.487268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263f357-2250-460c-9c8c-89381475656e None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:39.498956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 127/268] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/role_assignments?user.id=51a63f2df0684f34a5630c1724af0096&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=5cb95ca9624d408a80d77ecc45d0c310 => generated 608 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:39.557005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12fdfe-e4b4-4da9-a332-c05dbe1f14c0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:39.593206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d4278-e2f8-4e64-aba4-4ee9576d8357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:39.593866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d4278-e2f8-4e64-aba4-4ee9576d8357 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.594175 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d4278-e2f8-4e64-aba4-4ee9576d8357 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.594451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d4278-e2f8-4e64-aba4-4ee9576d8357 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.595283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d4278-e2f8-4e64-aba4-4ee9576d8357 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=19b8d221fd644566a8af166462a8a3db, user.id=51a63f2df0684f34a5630c1724af0096) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:39.595590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d4278-e2f8-4e64-aba4-4ee9576d8357 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:39.597110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d4278-e2f8-4e64-aba4-4ee9576d8357 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:39.599100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:39.603718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 142/269] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/role_assignments?user.id=51a63f2df0684f34a5630c1724af0096&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=308d9785120a49079e02659953a2b033 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:39.715775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e4571-2e17-492f-ad98-becbde664aa1 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.716137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e4571-2e17-492f-ad98-becbde664aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.716375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e4571-2e17-492f-ad98-becbde664aa1 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.717863 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 128/270] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:39.723648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2e45-1dac-48ae-aeb1-383860fd02f2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.724165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2e45-1dac-48ae-aeb1-383860fd02f2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.724165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2e45-1dac-48ae-aeb1-383860fd02f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.746796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-aacb2e45-1dac-48ae-aeb1-383860fd02f2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:39.747992 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-aacb2e45-1dac-48ae-aeb1-383860fd02f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:39.832332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 143/271] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:39.833782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dbcf6-0886-4d95-a84e-a3ae788305f7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.836153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dbcf6-0886-4d95-a84e-a3ae788305f7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.836153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4dbcf6-0886-4d95-a84e-a3ae788305f7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.836444 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 129/272] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:39.851671 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb04a0-a153-4d38-af13-9c86d5bba67f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:39.852212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb04a0-a153-4d38-af13-9c86d5bba67f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:39.852661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb04a0-a153-4d38-af13-9c86d5bba67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:39.866130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dbcf6-0886-4d95-a84e-a3ae788305f7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:39.874722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-50cb04a0-a153-4d38-af13-9c86d5bba67f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:39.876991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-50cb04a0-a153-4d38-af13-9c86d5bba67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:39.960358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 144/273] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:39.990526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:39.999257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb04a0-a153-4d38-af13-9c86d5bba67f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.037229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4dbcf6-0886-4d95-a84e-a3ae788305f7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.078741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.083120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0164dd99-63ab-4e0b-8b2e-781b011057d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.083894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164dd99-63ab-4e0b-8b2e-781b011057d9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.084278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164dd99-63ab-4e0b-8b2e-781b011057d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.084600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0164dd99-63ab-4e0b-8b2e-781b011057d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.098494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0164dd99-63ab-4e0b-8b2e-781b011057d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-0164dd99-63ab-4e0b-8b2e-781b011057d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:40.107538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:40.108423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:40.109603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 130/274] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:40.110257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e57361-a773-41b3-8e13-e7fce389d68d None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.110257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e57361-a773-41b3-8e13-e7fce389d68d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.110698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e57361-a773-41b3-8e13-e7fce389d68d None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.111778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 131/275] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:40.117370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820753e5-3d27-43bd-ab68-6530bf973b82 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.117657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820753e5-3d27-43bd-ab68-6530bf973b82 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.117938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820753e5-3d27-43bd-ab68-6530bf973b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.136528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb04a0-a153-4d38-af13-9c86d5bba67f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.138473 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-820753e5-3d27-43bd-ab68-6530bf973b82 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:40.139890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-820753e5-3d27-43bd-ab68-6530bf973b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:40.175652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8263335-c78b-4022-9bac-2d15c50619f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.177270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8263335-c78b-4022-9bac-2d15c50619f4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.177726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8263335-c78b-4022-9bac-2d15c50619f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.178280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8263335-c78b-4022-9bac-2d15c50619f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.179733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8263335-c78b-4022-9bac-2d15c50619f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.181371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8263335-c78b-4022-9bac-2d15c50619f4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.183336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 145/276] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:40.184622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8263335-c78b-4022-9bac-2d15c50619f4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.216370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 132/277] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:40.217018 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820753e5-3d27-43bd-ab68-6530bf973b82 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.285859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.307596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8263335-c78b-4022-9bac-2d15c50619f4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.331566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820753e5-3d27-43bd-ab68-6530bf973b82 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.340361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.350845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961fd1-bc1b-4b10-b229-2b84a8101ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.351514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961fd1-bc1b-4b10-b229-2b84a8101ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.351801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961fd1-bc1b-4b10-b229-2b84a8101ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.352081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17961fd1-bc1b-4b10-b229-2b84a8101ed0 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.353166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961fd1-bc1b-4b10-b229-2b84a8101ed0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:40.353166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961fd1-bc1b-4b10-b229-2b84a8101ed0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.354542 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17961fd1-bc1b-4b10-b229-2b84a8101ed0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.364466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 146/278] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:40.364982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961fd1-bc1b-4b10-b229-2b84a8101ed0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.371766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a87e63-808d-469b-ab28-07e5c148c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.372439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a87e63-808d-469b-ab28-07e5c148c701 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.372720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a87e63-808d-469b-ab28-07e5c148c701 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.372993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a87e63-808d-469b-ab28-07e5c148c701 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.373705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a87e63-808d-469b-ab28-07e5c148c701 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.375179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a87e63-808d-469b-ab28-07e5c148c701 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.396052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 133/279] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:28:40 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:40.404104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a87e63-808d-469b-ab28-07e5c148c701 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.498018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17961fd1-bc1b-4b10-b229-2b84a8101ed0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.534127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a87e63-808d-469b-ab28-07e5c148c701 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.536646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf63f7-0fd6-488d-82e7-82e81c554b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.537466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf63f7-0fd6-488d-82e7-82e81c554b4e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.537748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf63f7-0fd6-488d-82e7-82e81c554b4e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.538022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf63f7-0fd6-488d-82e7-82e81c554b4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.550312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bf63f7-0fd6-488d-82e7-82e81c554b4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:40.550497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e8bf63f7-0fd6-488d-82e7-82e81c554b4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:40.558961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:40.559902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:40.560679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:40.565264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 147/280] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:40.566225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf63f7-0fd6-488d-82e7-82e81c554b4e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.580171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e9a46-9d67-4c60-8eed-36c1eb9fb482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.580494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e9a46-9d67-4c60-8eed-36c1eb9fb482 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.582893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e9a46-9d67-4c60-8eed-36c1eb9fb482 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.582893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e9a46-9d67-4c60-8eed-36c1eb9fb482 None admin] PATH_INFO: `/v3/users/b48f29106447496ebab37f4405509205` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.599484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e9a46-9d67-4c60-8eed-36c1eb9fb482 None admin] RBAC: Authorizing `identity:get_user(user_id=b48f29106447496ebab37f4405509205)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.600882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e9a46-9d67-4c60-8eed-36c1eb9fb482 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.603317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 134/281] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/users/b48f29106447496ebab37f4405509205 => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:40.608391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e9a46-9d67-4c60-8eed-36c1eb9fb482 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.628967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.695219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf63f7-0fd6-488d-82e7-82e81c554b4e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.734959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e9a46-9d67-4c60-8eed-36c1eb9fb482 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.736607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674a0ba-5a12-4a46-ad10-54bdafebafa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.737286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674a0ba-5a12-4a46-ad10-54bdafebafa3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.737567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674a0ba-5a12-4a46-ad10-54bdafebafa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.737840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674a0ba-5a12-4a46-ad10-54bdafebafa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.738721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674a0ba-5a12-4a46-ad10-54bdafebafa3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:40.739542 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674a0ba-5a12-4a46-ad10-54bdafebafa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.741529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674a0ba-5a12-4a46-ad10-54bdafebafa3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.749764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 148/282] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:40.758260 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674a0ba-5a12-4a46-ad10-54bdafebafa3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:40.776596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77257f7c-c29a-484b-94c6-a2b7b52a56c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.777273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77257f7c-c29a-484b-94c6-a2b7b52a56c0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.777528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77257f7c-c29a-484b-94c6-a2b7b52a56c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.777797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77257f7c-c29a-484b-94c6-a2b7b52a56c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.778660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77257f7c-c29a-484b-94c6-a2b7b52a56c0 None admin] RBAC: Adding query filter params (role.id=faabf98abc6d4899b452e792928050ca, user.id=b48f29106447496ebab37f4405509205, scope.system=all) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:40.778968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77257f7c-c29a-484b-94c6-a2b7b52a56c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.780435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77257f7c-c29a-484b-94c6-a2b7b52a56c0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.788153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 135/283] 10.222.0.79 () {56 vars in 1308 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/role_assignments?user.id=b48f29106447496ebab37f4405509205&scope.system=all&role.id=faabf98abc6d4899b452e792928050ca => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:40.887120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674a0ba-5a12-4a46-ad10-54bdafebafa3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:40.899270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:40.933468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7d52-4b4e-4ed0-8915-f34537509e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:40.934408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7d52-4b4e-4ed0-8915-f34537509e86 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:40.934692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7d52-4b4e-4ed0-8915-f34537509e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:40.934966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c7d52-4b4e-4ed0-8915-f34537509e86 None admin] PATH_INFO: `/v3/users/246094af068344c5bd2982ddaed2cb1f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:40.938908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c7d52-4b4e-4ed0-8915-f34537509e86 None admin] RBAC: Authorizing `identity:get_user(user_id=246094af068344c5bd2982ddaed2cb1f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:40.940433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c7d52-4b4e-4ed0-8915-f34537509e86 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:40.942438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 149/284] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/users/246094af068344c5bd2982ddaed2cb1f => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:40.948324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77257f7c-c29a-484b-94c6-a2b7b52a56c0 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.021296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:41.116420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77257f7c-c29a-484b-94c6-a2b7b52a56c0 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.167339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4be5d1-95cd-4e69-b9e2-444d5dbd141a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.168220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4be5d1-95cd-4e69-b9e2-444d5dbd141a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.168502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4be5d1-95cd-4e69-b9e2-444d5dbd141a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.168776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4be5d1-95cd-4e69-b9e2-444d5dbd141a None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.169997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4be5d1-95cd-4e69-b9e2-444d5dbd141a None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.171472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4be5d1-95cd-4e69-b9e2-444d5dbd141a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.173174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 136/285] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:40 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:41.180108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7d52-4b4e-4ed0-8915-f34537509e86 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.302004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498f82b-e809-4135-bd3e-26191f8f880e None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.302405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498f82b-e809-4135-bd3e-26191f8f880e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.302665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498f82b-e809-4135-bd3e-26191f8f880e None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.305619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 137/286] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:41.310374 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69efc0a-5a2a-4672-955e-c9f1952d79ef None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.310680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69efc0a-5a2a-4672-955e-c9f1952d79ef None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.311035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69efc0a-5a2a-4672-955e-c9f1952d79ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.320373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c7d52-4b4e-4ed0-8915-f34537509e86 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.343905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a69efc0a-5a2a-4672-955e-c9f1952d79ef None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:41.345111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a69efc0a-5a2a-4672-955e-c9f1952d79ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:41.380925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc6d9-9028-4aa0-99b0-5e9997cc43e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.381832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc6d9-9028-4aa0-99b0-5e9997cc43e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.382645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc6d9-9028-4aa0-99b0-5e9997cc43e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.382645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc6d9-9028-4aa0-99b0-5e9997cc43e2 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db/users/246094af068344c5bd2982ddaed2cb1f/roles/e6190de07af44357a40a6be75cf7431c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.385917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc6d9-9028-4aa0-99b0-5e9997cc43e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=19b8d221fd644566a8af166462a8a3db, user_id=246094af068344c5bd2982ddaed2cb1f, role_id=e6190de07af44357a40a6be75cf7431c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.388741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47bc6d9-9028-4aa0-99b0-5e9997cc43e2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.412349 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 150/287] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:28:41 2022] PUT /identity/v3/projects/19b8d221fd644566a8af166462a8a3db/users/246094af068344c5bd2982ddaed2cb1f/roles/e6190de07af44357a40a6be75cf7431c => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:41.462531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 138/288] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:41.498145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc6d9-9028-4aa0-99b0-5e9997cc43e2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.548707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:41.635615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc6d9-9028-4aa0-99b0-5e9997cc43e2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.682196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717469e0-a756-4426-8798-109578b608a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.683001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717469e0-a756-4426-8798-109578b608a3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.683283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717469e0-a756-4426-8798-109578b608a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.683557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717469e0-a756-4426-8798-109578b608a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.707376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717469e0-a756-4426-8798-109578b608a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-717469e0-a756-4426-8798-109578b608a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:41.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:41.716962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:41.717732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 151/289] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:41.724492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69efc0a-5a2a-4672-955e-c9f1952d79ef None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:41.776391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:41.850518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69efc0a-5a2a-4672-955e-c9f1952d79ef None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:41.887214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd9903-b76f-468f-94c1-8ac8accedaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:41.887877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd9903-b76f-468f-94c1-8ac8accedaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:41.888158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd9903-b76f-468f-94c1-8ac8accedaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:41.888430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd9903-b76f-468f-94c1-8ac8accedaa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:41.889174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd9903-b76f-468f-94c1-8ac8accedaa2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:41.889472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd9903-b76f-468f-94c1-8ac8accedaa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:41.890884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd9903-b76f-468f-94c1-8ac8accedaa2 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:41.899417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 139/290] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:41.905676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717469e0-a756-4426-8798-109578b608a3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:42.033804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:42.039409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717469e0-a756-4426-8798-109578b608a3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:42.086400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba6ea1-9f0f-4fbe-9396-e1f498d16cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:42.087657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba6ea1-9f0f-4fbe-9396-e1f498d16cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:42.088121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba6ea1-9f0f-4fbe-9396-e1f498d16cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:42.088572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba6ea1-9f0f-4fbe-9396-e1f498d16cd2 None admin] PATH_INFO: `/v3/users/d4f6b00806ec4f8cbff275de6cd892b3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:42.090177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba6ea1-9f0f-4fbe-9396-e1f498d16cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=d4f6b00806ec4f8cbff275de6cd892b3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:42.091908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba6ea1-9f0f-4fbe-9396-e1f498d16cd2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:42.094955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 152/291] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:41 2022] GET /identity/v3/users/d4f6b00806ec4f8cbff275de6cd892b3 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:42.099504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd9903-b76f-468f-94c1-8ac8accedaa2 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:42.217350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:42.224992 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd9903-b76f-468f-94c1-8ac8accedaa2 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:42.266755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1491382-ac41-44ac-b456-263f2a10c8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:42.267409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491382-ac41-44ac-b456-263f2a10c8da None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:42.267688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491382-ac41-44ac-b456-263f2a10c8da None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:42.267962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1491382-ac41-44ac-b456-263f2a10c8da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:42.357481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1491382-ac41-44ac-b456-263f2a10c8da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:42.358955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1491382-ac41-44ac-b456-263f2a10c8da None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:42.454003 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:42.463496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 140/292] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:42.471208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba6ea1-9f0f-4fbe-9396-e1f498d16cd2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:42.611053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba6ea1-9f0f-4fbe-9396-e1f498d16cd2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:42.663695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e7b5c1-f3f6-4ebf-9c97-7c953b5a8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:42.664580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7b5c1-f3f6-4ebf-9c97-7c953b5a8513 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:42.664865 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7b5c1-f3f6-4ebf-9c97-7c953b5a8513 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:42.665142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e7b5c1-f3f6-4ebf-9c97-7c953b5a8513 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:42.666364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7b5c1-f3f6-4ebf-9c97-7c953b5a8513 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:42.667823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e7b5c1-f3f6-4ebf-9c97-7c953b5a8513 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:42.669842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 153/293] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:42 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:42.675323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1491382-ac41-44ac-b456-263f2a10c8da None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:42.823326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1491382-ac41-44ac-b456-263f2a10c8da None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:42.869696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f535ca-4f45-4f23-b823-3c867404c05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:42.870323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f535ca-4f45-4f23-b823-3c867404c05a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:42.870608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f535ca-4f45-4f23-b823-3c867404c05a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:42.870887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f535ca-4f45-4f23-b823-3c867404c05a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:42.871733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f535ca-4f45-4f23-b823-3c867404c05a None admin] RBAC: Adding query filter params (role.id=faabf98abc6d4899b452e792928050ca, scope.project.id=19b8d221fd644566a8af166462a8a3db, user.id=d4f6b00806ec4f8cbff275de6cd892b3) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:42.872046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f535ca-4f45-4f23-b823-3c867404c05a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:42.873513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f535ca-4f45-4f23-b823-3c867404c05a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:42.884042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 141/294] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:42 2022] GET /identity/v3/role_assignments?user.id=d4f6b00806ec4f8cbff275de6cd892b3&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=faabf98abc6d4899b452e792928050ca => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:43.308382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d0816-63ca-4f1a-ae96-40c86bea0b70 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.309357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d0816-63ca-4f1a-ae96-40c86bea0b70 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.309856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d0816-63ca-4f1a-ae96-40c86bea0b70 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.311703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 154/295] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:43.317201 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa7b9-2c20-4dfd-9344-b0ba5ebd5ff5 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.317741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa7b9-2c20-4dfd-9344-b0ba5ebd5ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.318282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fa7b9-2c20-4dfd-9344-b0ba5ebd5ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.337570 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-f25fa7b9-2c20-4dfd-9344-b0ba5ebd5ff5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:43.339129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f25fa7b9-2c20-4dfd-9344-b0ba5ebd5ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:43.357763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bd667-cca7-49a8-b9ea-d49efe661a8d None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.358060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bd667-cca7-49a8-b9ea-d49efe661a8d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.358363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6bd667-cca7-49a8-b9ea-d49efe661a8d None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.359885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 155/296] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:43.366555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f97d7f-1350-4340-b359-d5415d5d463f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.367245 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f97d7f-1350-4340-b359-d5415d5d463f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.368053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f97d7f-1350-4340-b359-d5415d5d463f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.389488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-16f97d7f-1350-4340-b359-d5415d5d463f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:43.391746 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-16f97d7f-1350-4340-b359-d5415d5d463f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:43.403354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:43.422665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 142/297] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:43.433842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:43.455154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fa7b9-2c20-4dfd-9344-b0ba5ebd5ff5 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:43.488145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 156/298] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:43.508415 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cebca-3267-410f-aa81-ffcba88fda13 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.508800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cebca-3267-410f-aa81-ffcba88fda13 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.509082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cebca-3267-410f-aa81-ffcba88fda13 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.510895 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 157/299] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:43.516038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb09e5-c382-440e-868c-ae0d11dfa275 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.516330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb09e5-c382-440e-868c-ae0d11dfa275 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.516614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb09e5-c382-440e-868c-ae0d11dfa275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.533771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-00eb09e5-c382-440e-868c-ae0d11dfa275 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:43.534953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-00eb09e5-c382-440e-868c-ae0d11dfa275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:43.569882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fa7b9-2c20-4dfd-9344-b0ba5ebd5ff5 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:43.603830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 158/300] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:43.604741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb09e5-c382-440e-868c-ae0d11dfa275 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:43.613072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f07b06-5ce2-4de3-9ba6-941d8e2984b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:43.614194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f07b06-5ce2-4de3-9ba6-941d8e2984b5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.614670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f07b06-5ce2-4de3-9ba6-941d8e2984b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.615133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f07b06-5ce2-4de3-9ba6-941d8e2984b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.616586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f07b06-5ce2-4de3-9ba6-941d8e2984b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:43.618353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f07b06-5ce2-4de3-9ba6-941d8e2984b5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:43.620531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 143/301] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:43.629775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f07b06-5ce2-4de3-9ba6-941d8e2984b5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:43.689603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:43.703859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:43.711198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb09e5-c382-440e-868c-ae0d11dfa275 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:43.736013 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f07b06-5ce2-4de3-9ba6-941d8e2984b5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:43.745285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349d2ef-bf70-4ec2-8cd6-5460851e1e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:43.746191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349d2ef-bf70-4ec2-8cd6-5460851e1e8d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.746473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349d2ef-bf70-4ec2-8cd6-5460851e1e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.746744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349d2ef-bf70-4ec2-8cd6-5460851e1e8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.757806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349d2ef-bf70-4ec2-8cd6-5460851e1e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e349d2ef-bf70-4ec2-8cd6-5460851e1e8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:43.766484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:43.767322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:43.768096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 159/302] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:43.768716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349d2ef-bf70-4ec2-8cd6-5460851e1e8d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:43.775984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b844ef-3c00-41da-8639-cf55ee7fdd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:43.776653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b844ef-3c00-41da-8639-cf55ee7fdd3f None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.776931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b844ef-3c00-41da-8639-cf55ee7fdd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.777202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b844ef-3c00-41da-8639-cf55ee7fdd3f None admin] PATH_INFO: `/v3/groups` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.777891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b844ef-3c00-41da-8639-cf55ee7fdd3f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:43.779354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b844ef-3c00-41da-8639-cf55ee7fdd3f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:43.806121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 144/303] 10.222.0.79 () {60 vars in 1134 bytes} [Wed May 25 14:28:43 2022] POST /identity/v3/groups => generated 229 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:43.806121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b844ef-3c00-41da-8639-cf55ee7fdd3f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:43.905535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349d2ef-bf70-4ec2-8cd6-5460851e1e8d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:43.944837 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652327e-824e-446c-9d4c-486e9446a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:43.946077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652327e-824e-446c-9d4c-486e9446a6bb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:43.946572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652327e-824e-446c-9d4c-486e9446a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:43.947018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652327e-824e-446c-9d4c-486e9446a6bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:43.956082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b844ef-3c00-41da-8639-cf55ee7fdd3f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:43.960809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652327e-824e-446c-9d4c-486e9446a6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3652327e-824e-446c-9d4c-486e9446a6bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:43.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:43.970520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:43.971293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:43.974395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 160/304] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:43.980295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652327e-824e-446c-9d4c-486e9446a6bb None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:43.982297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.001381 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.019984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644b00f-7423-46ee-8f4e-526faf5781ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.020927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b00f-7423-46ee-8f4e-526faf5781ad None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.020927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b00f-7423-46ee-8f4e-526faf5781ad None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.021182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644b00f-7423-46ee-8f4e-526faf5781ad None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.021938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644b00f-7423-46ee-8f4e-526faf5781ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:44.022268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644b00f-7423-46ee-8f4e-526faf5781ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.023658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1644b00f-7423-46ee-8f4e-526faf5781ad None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.033286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 145/305] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:44.040610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644b00f-7423-46ee-8f4e-526faf5781ad None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.133580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652327e-824e-446c-9d4c-486e9446a6bb None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.159030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644b00f-7423-46ee-8f4e-526faf5781ad None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.169410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546f26e-f7ef-4fbe-8711-7ad9f14c2054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.170159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546f26e-f7ef-4fbe-8711-7ad9f14c2054 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.170449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546f26e-f7ef-4fbe-8711-7ad9f14c2054 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.170767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546f26e-f7ef-4fbe-8711-7ad9f14c2054 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.171513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546f26e-f7ef-4fbe-8711-7ad9f14c2054 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:44.171816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546f26e-f7ef-4fbe-8711-7ad9f14c2054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.173194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546f26e-f7ef-4fbe-8711-7ad9f14c2054 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.182738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 161/306] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:44.188367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546f26e-f7ef-4fbe-8711-7ad9f14c2054 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.204287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c7e9c-1891-4c65-9d82-0beb05f50c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.206150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7e9c-1891-4c65-9d82-0beb05f50c7a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.208230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7e9c-1891-4c65-9d82-0beb05f50c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.208493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c7e9c-1891-4c65-9d82-0beb05f50c7a None admin] PATH_INFO: `/v3/users/b48f29106447496ebab37f4405509205` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.210604 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c7e9c-1891-4c65-9d82-0beb05f50c7a None admin] RBAC: Authorizing `identity:get_user(user_id=b48f29106447496ebab37f4405509205)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.214414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c7e9c-1891-4c65-9d82-0beb05f50c7a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.222571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 146/307] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/users/b48f29106447496ebab37f4405509205 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:44.225423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c7e9c-1891-4c65-9d82-0beb05f50c7a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.284339 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.293437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.320075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546f26e-f7ef-4fbe-8711-7ad9f14c2054 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.350308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c7e9c-1891-4c65-9d82-0beb05f50c7a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.373785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032b035-5044-401a-8b62-42e2267fd751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.375039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b035-5044-401a-8b62-42e2267fd751 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.375324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b035-5044-401a-8b62-42e2267fd751 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.375599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b035-5044-401a-8b62-42e2267fd751 None admin] PATH_INFO: `/v3/users/98631608a63c49b2821f27649871c856` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.392512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032b035-5044-401a-8b62-42e2267fd751 None admin] RBAC: Authorizing `identity:get_user(user_id=98631608a63c49b2821f27649871c856)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.392921 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1943a9f-fa45-491a-8f0f-8d6641d92f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.393780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1943a9f-fa45-491a-8f0f-8d6641d92f53 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.393958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032b035-5044-401a-8b62-42e2267fd751 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.394068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1943a9f-fa45-491a-8f0f-8d6641d92f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.394342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1943a9f-fa45-491a-8f0f-8d6641d92f53 None admin] PATH_INFO: `/v3/system/users/b48f29106447496ebab37f4405509205/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.395841 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1943a9f-fa45-491a-8f0f-8d6641d92f53 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b48f29106447496ebab37f4405509205, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.396199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 162/308] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/users/98631608a63c49b2821f27649871c856 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:44.399496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1943a9f-fa45-491a-8f0f-8d6641d92f53 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.401719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032b035-5044-401a-8b62-42e2267fd751 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.409616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 147/309] 10.222.0.79 () {58 vars in 1334 bytes} [Wed May 25 14:28:44 2022] PUT /identity/v3/system/users/b48f29106447496ebab37f4405509205/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:44.433609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da16284-5aa3-465d-b24e-2f359f2a1407 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.434100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da16284-5aa3-465d-b24e-2f359f2a1407 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.434499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da16284-5aa3-465d-b24e-2f359f2a1407 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.436552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 148/310] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:44.442111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c44054-a64d-4de2-aa3f-8c00633b18b8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.442431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c44054-a64d-4de2-aa3f-8c00633b18b8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.442689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c44054-a64d-4de2-aa3f-8c00633b18b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.463566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-b1c44054-a64d-4de2-aa3f-8c00633b18b8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:44.464977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b1c44054-a64d-4de2-aa3f-8c00633b18b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:44.540922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032b035-5044-401a-8b62-42e2267fd751 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.562127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 149/311] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:44.583722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c44054-a64d-4de2-aa3f-8c00633b18b8 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.593286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5184f8-ee69-482c-9d7c-7e6c51f609b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.594447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5184f8-ee69-482c-9d7c-7e6c51f609b6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.595291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5184f8-ee69-482c-9d7c-7e6c51f609b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.596761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5184f8-ee69-482c-9d7c-7e6c51f609b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.596761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5184f8-ee69-482c-9d7c-7e6c51f609b6 None admin] RBAC: Adding query filter params (role.id=e6190de07af44357a40a6be75cf7431c, user.id=98631608a63c49b2821f27649871c856, scope.system=all) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:44.596761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5184f8-ee69-482c-9d7c-7e6c51f609b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.599422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5184f8-ee69-482c-9d7c-7e6c51f609b6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.601813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.607135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 163/312] 10.222.0.79 () {56 vars in 1308 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/role_assignments?user.id=98631608a63c49b2821f27649871c856&scope.system=all&role.id=e6190de07af44357a40a6be75cf7431c => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:44.646720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:44.715057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c44054-a64d-4de2-aa3f-8c00633b18b8 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.764027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2088684-84a2-4830-940c-cbc457882995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.764855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2088684-84a2-4830-940c-cbc457882995 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.765138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2088684-84a2-4830-940c-cbc457882995 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.765415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2088684-84a2-4830-940c-cbc457882995 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.777832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2088684-84a2-4830-940c-cbc457882995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-d2088684-84a2-4830-940c-cbc457882995 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:44.790878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:44.791818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:44.793094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 150/313] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:44.798986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5184f8-ee69-482c-9d7c-7e6c51f609b6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:44.932725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5184f8-ee69-482c-9d7c-7e6c51f609b6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:44.976360 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892711d-e24c-4816-bd66-6c795fbec63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:44.977039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892711d-e24c-4816-bd66-6c795fbec63c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:44.977323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892711d-e24c-4816-bd66-6c795fbec63c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:44.977601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892711d-e24c-4816-bd66-6c795fbec63c None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:44.978391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892711d-e24c-4816-bd66-6c795fbec63c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:44.978698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892711d-e24c-4816-bd66-6c795fbec63c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:44.980088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892711d-e24c-4816-bd66-6c795fbec63c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:44.988887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 164/314] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:44.999137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2088684-84a2-4830-940c-cbc457882995 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:45.120389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:45.124414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2088684-84a2-4830-940c-cbc457882995 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.161710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a46359-9aed-4150-92f2-a26109fd39d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.162629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a46359-9aed-4150-92f2-a26109fd39d5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.162913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a46359-9aed-4150-92f2-a26109fd39d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.163191 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a46359-9aed-4150-92f2-a26109fd39d5 None admin] PATH_INFO: `/v3/users/246094af068344c5bd2982ddaed2cb1f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.164411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a46359-9aed-4150-92f2-a26109fd39d5 None admin] RBAC: Authorizing `identity:get_user(user_id=246094af068344c5bd2982ddaed2cb1f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.165871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a46359-9aed-4150-92f2-a26109fd39d5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.167864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 151/315] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:44 2022] GET /identity/v3/users/246094af068344c5bd2982ddaed2cb1f => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:45.173397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892711d-e24c-4816-bd66-6c795fbec63c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:45.245396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:45.291562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892711d-e24c-4816-bd66-6c795fbec63c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.328258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744c8f3-757b-4185-b4ed-1fc39e51f9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.329680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744c8f3-757b-4185-b4ed-1fc39e51f9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.330214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744c8f3-757b-4185-b4ed-1fc39e51f9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.330697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744c8f3-757b-4185-b4ed-1fc39e51f9c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.406107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744c8f3-757b-4185-b4ed-1fc39e51f9c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.406974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744c8f3-757b-4185-b4ed-1fc39e51f9c4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.467531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:45.511171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 165/316] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:45.517157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a46359-9aed-4150-92f2-a26109fd39d5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:45.642540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a46359-9aed-4150-92f2-a26109fd39d5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.678565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb167a5-19ea-46dd-9579-fe8f2fb089f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.679433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb167a5-19ea-46dd-9579-fe8f2fb089f5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.679788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb167a5-19ea-46dd-9579-fe8f2fb089f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.680177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb167a5-19ea-46dd-9579-fe8f2fb089f5 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.681249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb167a5-19ea-46dd-9579-fe8f2fb089f5 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.682749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb167a5-19ea-46dd-9579-fe8f2fb089f5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.684464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 152/317] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:45 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:45.690331 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744c8f3-757b-4185-b4ed-1fc39e51f9c4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:45.796444 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744c8f3-757b-4185-b4ed-1fc39e51f9c4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:45.835906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac85b1-a1b2-4e5f-a3cf-f0423134bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:45.836568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac85b1-a1b2-4e5f-a3cf-f0423134bca5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:45.836851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac85b1-a1b2-4e5f-a3cf-f0423134bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:45.837129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac85b1-a1b2-4e5f-a3cf-f0423134bca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:45.837967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac85b1-a1b2-4e5f-a3cf-f0423134bca5 None admin] RBAC: Adding query filter params (role.id=e6190de07af44357a40a6be75cf7431c, scope.project.id=19b8d221fd644566a8af166462a8a3db, user.id=246094af068344c5bd2982ddaed2cb1f) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:45.838304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac85b1-a1b2-4e5f-a3cf-f0423134bca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:45.839764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac85b1-a1b2-4e5f-a3cf-f0423134bca5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:45.846143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 166/318] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:28:45 2022] GET /identity/v3/role_assignments?user.id=246094af068344c5bd2982ddaed2cb1f&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=e6190de07af44357a40a6be75cf7431c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:46.149353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710e31a-cc29-4a03-8920-2db350a3eee6 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.149832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710e31a-cc29-4a03-8920-2db350a3eee6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.149832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710e31a-cc29-4a03-8920-2db350a3eee6 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.151242 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 153/319] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:46.156616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cde50c-db8b-46c5-85d0-858ac0c02417 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.156911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cde50c-db8b-46c5-85d0-858ac0c02417 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.157193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cde50c-db8b-46c5-85d0-858ac0c02417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.173768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-71cde50c-db8b-46c5-85d0-858ac0c02417 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:46.174974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-71cde50c-db8b-46c5-85d0-858ac0c02417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:46.193595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:46.245128 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 167/320] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:46.268326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710e31a-cc29-4a03-8920-2db350a3eee6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:46.306592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:46.374568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710e31a-cc29-4a03-8920-2db350a3eee6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:46.409349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4aeb91-229b-44ce-8925-81abbd927458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:46.410402 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aeb91-229b-44ce-8925-81abbd927458 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.410824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aeb91-229b-44ce-8925-81abbd927458 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.411237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4aeb91-229b-44ce-8925-81abbd927458 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.412567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4aeb91-229b-44ce-8925-81abbd927458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:46.414200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4aeb91-229b-44ce-8925-81abbd927458 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:46.416235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 154/321] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:28:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:46.421721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cde50c-db8b-46c5-85d0-858ac0c02417 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:46.528287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cde50c-db8b-46c5-85d0-858ac0c02417 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:46.561919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d730d7c-6d58-450a-b722-272f2380286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:46.562610 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d730d7c-6d58-450a-b722-272f2380286b None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.562896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d730d7c-6d58-450a-b722-272f2380286b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.563167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d730d7c-6d58-450a-b722-272f2380286b None admin] PATH_INFO: `/v3/groups` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.563861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d730d7c-6d58-450a-b722-272f2380286b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:46.565321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d730d7c-6d58-450a-b722-272f2380286b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:46.580505 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 168/322] 10.222.0.79 () {60 vars in 1134 bytes} [Wed May 25 14:28:46 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:28:46.792350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac331e-8299-414e-bf48-ddfe977cc8c9 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.792550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac331e-8299-414e-bf48-ddfe977cc8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.792825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac331e-8299-414e-bf48-ddfe977cc8c9 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.794270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 155/323] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:46.799524 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc177-735b-437f-9536-15242bf8be70 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.799814 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc177-735b-437f-9536-15242bf8be70 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.800087 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469dc177-735b-437f-9536-15242bf8be70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.817724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-469dc177-735b-437f-9536-15242bf8be70 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:46.818963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-469dc177-735b-437f-9536-15242bf8be70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:46.829566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:46.896602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 169/324] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:46.906761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74790958-402e-4f32-8a9f-ffdfa1afdee0 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.907036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74790958-402e-4f32-8a9f-ffdfa1afdee0 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.907315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74790958-402e-4f32-8a9f-ffdfa1afdee0 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.908669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 156/325] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:46.914576 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54eb47-f07d-4a62-b93c-27b8f6082289 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:46.914863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54eb47-f07d-4a62-b93c-27b8f6082289 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:46.915135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54eb47-f07d-4a62-b93c-27b8f6082289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:46.922165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74790958-402e-4f32-8a9f-ffdfa1afdee0 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:46.932948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-dc54eb47-f07d-4a62-b93c-27b8f6082289 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:46.933517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-dc54eb47-f07d-4a62-b93c-27b8f6082289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:47.008282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 170/326] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:47.031217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54eb47-f07d-4a62-b93c-27b8f6082289 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:47.047776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74790958-402e-4f32-8a9f-ffdfa1afdee0 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:47.052414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:47.092900 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f8a46-919f-4f89-a6f4-2687ed345a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:47.093716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f8a46-919f-4f89-a6f4-2687ed345a3b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.094001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f8a46-919f-4f89-a6f4-2687ed345a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.094305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f8a46-919f-4f89-a6f4-2687ed345a3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.106753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f8a46-919f-4f89-a6f4-2687ed345a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-a88f8a46-919f-4f89-a6f4-2687ed345a3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:47.115132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:47.115986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:47.116784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 157/327] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:47.121034 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:47.124627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f8a46-919f-4f89-a6f4-2687ed345a3b None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:47.150788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54eb47-f07d-4a62-b93c-27b8f6082289 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:47.188135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dd785-047a-41a1-817e-6be47095cbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:47.189297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd785-047a-41a1-817e-6be47095cbf3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.189831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd785-047a-41a1-817e-6be47095cbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.190458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420dd785-047a-41a1-817e-6be47095cbf3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.205486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420dd785-047a-41a1-817e-6be47095cbf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-420dd785-047a-41a1-817e-6be47095cbf3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:47.215714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:47.216628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:47.217387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:47.219676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 171/328] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:47.225433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dd785-047a-41a1-817e-6be47095cbf3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:47.250579 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f8a46-919f-4f89-a6f4-2687ed345a3b None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:47.297901 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d528f1-bd41-44a3-8a98-57b73f618249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:47.299048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d528f1-bd41-44a3-8a98-57b73f618249 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.299858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d528f1-bd41-44a3-8a98-57b73f618249 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.300332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d528f1-bd41-44a3-8a98-57b73f618249 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.301509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d528f1-bd41-44a3-8a98-57b73f618249 None admin] RBAC: Adding query filter params (name=member) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:47.302150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d528f1-bd41-44a3-8a98-57b73f618249 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:47.304286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d528f1-bd41-44a3-8a98-57b73f618249 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:47.314409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 158/329] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:47.320147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d528f1-bd41-44a3-8a98-57b73f618249 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:47.358443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:47.365342 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420dd785-047a-41a1-817e-6be47095cbf3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:47.418039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb648f38-e7f6-4c08-8a1d-ae7fceee6c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:47.418971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb648f38-e7f6-4c08-8a1d-ae7fceee6c24 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.419402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb648f38-e7f6-4c08-8a1d-ae7fceee6c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.419775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb648f38-e7f6-4c08-8a1d-ae7fceee6c24 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.421121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb648f38-e7f6-4c08-8a1d-ae7fceee6c24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:47.421725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb648f38-e7f6-4c08-8a1d-ae7fceee6c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:47.423646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb648f38-e7f6-4c08-8a1d-ae7fceee6c24 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:47.425624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:47.436561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 172/330] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:47.442459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb648f38-e7f6-4c08-8a1d-ae7fceee6c24 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:47.457434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d528f1-bd41-44a3-8a98-57b73f618249 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:47.501439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac9dd9-685b-4d3f-beca-a184692c92e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:47.502942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9dd9-685b-4d3f-beca-a184692c92e0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.503235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9dd9-685b-4d3f-beca-a184692c92e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.503512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac9dd9-685b-4d3f-beca-a184692c92e0 None admin] PATH_INFO: `/v3/users/b48f29106447496ebab37f4405509205` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.505832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac9dd9-685b-4d3f-beca-a184692c92e0 None admin] RBAC: Authorizing `identity:get_user(user_id=b48f29106447496ebab37f4405509205)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:47.507910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac9dd9-685b-4d3f-beca-a184692c92e0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:47.510625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 159/331] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:47 2022] GET /identity/v3/users/b48f29106447496ebab37f4405509205 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:47.516830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac9dd9-685b-4d3f-beca-a184692c92e0 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:47.574405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb648f38-e7f6-4c08-8a1d-ae7fceee6c24 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:47.613256 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b06efe-8a2d-465f-a419-0197a7325048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:47.614763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b06efe-8a2d-465f-a419-0197a7325048 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.615094 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b06efe-8a2d-465f-a419-0197a7325048 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.615459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b06efe-8a2d-465f-a419-0197a7325048 None admin] PATH_INFO: `/v3/users/98631608a63c49b2821f27649871c856` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.616735 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b06efe-8a2d-465f-a419-0197a7325048 None admin] RBAC: Authorizing `identity:get_user(user_id=98631608a63c49b2821f27649871c856)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:47.618494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:47.619177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b06efe-8a2d-465f-a419-0197a7325048 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:47.620956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 173/332] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:47 2022] GET /identity/v3/users/98631608a63c49b2821f27649871c856 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:47.625733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac9dd9-685b-4d3f-beca-a184692c92e0 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:47.627216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b06efe-8a2d-465f-a419-0197a7325048 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:47.662378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59bcf35-c7fd-4d4f-8023-102040720bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:47.663036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bcf35-c7fd-4d4f-8023-102040720bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.663323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bcf35-c7fd-4d4f-8023-102040720bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.663602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59bcf35-c7fd-4d4f-8023-102040720bd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.664440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bcf35-c7fd-4d4f-8023-102040720bd5 None admin] RBAC: Adding query filter params (role.id=faabf98abc6d4899b452e792928050ca, user.id=b48f29106447496ebab37f4405509205, scope.system=all) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:47.664755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bcf35-c7fd-4d4f-8023-102040720bd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:47.666228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59bcf35-c7fd-4d4f-8023-102040720bd5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:47.678859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 160/333] 10.222.0.79 () {56 vars in 1308 bytes} [Wed May 25 14:28:47 2022] GET /identity/v3/role_assignments?user.id=b48f29106447496ebab37f4405509205&scope.system=all&role.id=faabf98abc6d4899b452e792928050ca => generated 510 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:28:47.698581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:47.744537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b06efe-8a2d-465f-a419-0197a7325048 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:47.783663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abf788d-a495-4031-8e04-b10ff44e0be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:47.784577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf788d-a495-4031-8e04-b10ff44e0be7 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:47.784856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf788d-a495-4031-8e04-b10ff44e0be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:47.785120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abf788d-a495-4031-8e04-b10ff44e0be7 None admin] PATH_INFO: `/v3/system/users/98631608a63c49b2821f27649871c856/roles/e6190de07af44357a40a6be75cf7431c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:47.787461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf788d-a495-4031-8e04-b10ff44e0be7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=98631608a63c49b2821f27649871c856, role_id=e6190de07af44357a40a6be75cf7431c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:47.788870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abf788d-a495-4031-8e04-b10ff44e0be7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:47.800464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 174/334] 10.222.0.79 () {58 vars in 1334 bytes} [Wed May 25 14:28:47 2022] PUT /identity/v3/system/users/98631608a63c49b2821f27649871c856/roles/e6190de07af44357a40a6be75cf7431c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:49.746137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9773-f758-4f39-9ef4-ce377af273b6 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:49.746644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9773-f758-4f39-9ef4-ce377af273b6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:49.746644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e9773-f758-4f39-9ef4-ce377af273b6 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:49.748164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 161/335] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:49.753687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d049e-0d08-48f7-baf5-9edcc1f49de7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:49.755108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d049e-0d08-48f7-baf5-9edcc1f49de7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:49.755590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d049e-0d08-48f7-baf5-9edcc1f49de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:49.777981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-595d049e-0d08-48f7-baf5-9edcc1f49de7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:49.779548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-595d049e-0d08-48f7-baf5-9edcc1f49de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:49.875401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 175/336] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:49.919180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e9773-f758-4f39-9ef4-ce377af273b6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:50.055438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e9773-f758-4f39-9ef4-ce377af273b6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:50.073861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19713d6-57af-4bcd-bfe8-fb6b01baae24 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.074551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19713d6-57af-4bcd-bfe8-fb6b01baae24 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.075060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19713d6-57af-4bcd-bfe8-fb6b01baae24 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.076894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 176/337] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:50.092099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143b97-3a0d-41ad-89d0-4e9fc51e8d39 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.092715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143b97-3a0d-41ad-89d0-4e9fc51e8d39 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.093212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143b97-3a0d-41ad-89d0-4e9fc51e8d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.096217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3910dd-ee7a-44d3-8228-1f30adecaa12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:50.097009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3910dd-ee7a-44d3-8228-1f30adecaa12 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.097287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3910dd-ee7a-44d3-8228-1f30adecaa12 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.097556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3910dd-ee7a-44d3-8228-1f30adecaa12 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.112466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3910dd-ee7a-44d3-8228-1f30adecaa12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-0a3910dd-ee7a-44d3-8228-1f30adecaa12 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:50.120634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:50.121543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:50.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:50.126432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 162/338] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:50.132250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bf143b97-3a0d-41ad-89d0-4e9fc51e8d39 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:50.132385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3910dd-ee7a-44d3-8228-1f30adecaa12 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:50.133786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bf143b97-3a0d-41ad-89d0-4e9fc51e8d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:50.158111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:50.228594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:50.248333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 177/339] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:50.275557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143b97-3a0d-41ad-89d0-4e9fc51e8d39 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:50.353157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3910dd-ee7a-44d3-8228-1f30adecaa12 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:50.432989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143b97-3a0d-41ad-89d0-4e9fc51e8d39 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:50.440178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197e130-c849-497b-87f0-412cf049d931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:50.440862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197e130-c849-497b-87f0-412cf049d931 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.441145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197e130-c849-497b-87f0-412cf049d931 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.441950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197e130-c849-497b-87f0-412cf049d931 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.442743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197e130-c849-497b-87f0-412cf049d931 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:50.443054 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197e130-c849-497b-87f0-412cf049d931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:50.444454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197e130-c849-497b-87f0-412cf049d931 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:50.461576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 163/340] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:50.478911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197e130-c849-497b-87f0-412cf049d931 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:50.485226 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c119b8a-c9dd-4a44-92d5-14285aeb948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:50.486044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119b8a-c9dd-4a44-92d5-14285aeb948a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.486353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119b8a-c9dd-4a44-92d5-14285aeb948a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.486631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c119b8a-c9dd-4a44-92d5-14285aeb948a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.511331 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c119b8a-c9dd-4a44-92d5-14285aeb948a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3c119b8a-c9dd-4a44-92d5-14285aeb948a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:50.519367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:50.520818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:50.521625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 178/341] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:50.527463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d091226-73c4-4d4e-b2cb-e39c198e8da3 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.527761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d091226-73c4-4d4e-b2cb-e39c198e8da3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.528042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d091226-73c4-4d4e-b2cb-e39c198e8da3 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.529630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 179/342] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:50.530365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d091226-73c4-4d4e-b2cb-e39c198e8da3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:50.615995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:50.667198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d091226-73c4-4d4e-b2cb-e39c198e8da3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:50.670483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:50.687138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197e130-c849-497b-87f0-412cf049d931 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:50.712714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8ccff-0101-4ecc-b32c-a4d024be4718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:50.713398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ccff-0101-4ecc-b32c-a4d024be4718 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.713678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ccff-0101-4ecc-b32c-a4d024be4718 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.714129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ccff-0101-4ecc-b32c-a4d024be4718 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.715215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8ccff-0101-4ecc-b32c-a4d024be4718 None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:50.715788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8ccff-0101-4ecc-b32c-a4d024be4718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:50.717654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8ccff-0101-4ecc-b32c-a4d024be4718 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:50.726429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376feaaf-1ecd-4b27-9767-06a8c7612354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:50.727086 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376feaaf-1ecd-4b27-9767-06a8c7612354 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.727367 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376feaaf-1ecd-4b27-9767-06a8c7612354 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.727647 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376feaaf-1ecd-4b27-9767-06a8c7612354 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.728770 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 180/343] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:50.735436 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f64da-776a-45a2-a53b-26b3bdf7555d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.735726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f64da-776a-45a2-a53b-26b3bdf7555d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.736007 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f64da-776a-45a2-a53b-26b3bdf7555d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.761562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ef5f64da-776a-45a2-a53b-26b3bdf7555d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:50.763493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ef5f64da-776a-45a2-a53b-26b3bdf7555d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:50.819389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376feaaf-1ecd-4b27-9767-06a8c7612354 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:50.820917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376feaaf-1ecd-4b27-9767-06a8c7612354 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:50.855260 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 181/344] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:50.857655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411fbcf-5fb0-44cd-b577-23577d65c8d4 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.858527 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411fbcf-5fb0-44cd-b577-23577d65c8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.858994 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2411fbcf-5fb0-44cd-b577-23577d65c8d4 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.860666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 182/345] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:50.861535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411fbcf-5fb0-44cd-b577-23577d65c8d4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:50.921793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:50.924069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:50.954198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 164/346] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:50.954644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd99d6-7f5a-471e-a420-06693ba8589b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:50.954930 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd99d6-7f5a-471e-a420-06693ba8589b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:50.955205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffd99d6-7f5a-471e-a420-06693ba8589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:50.983512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-0ffd99d6-7f5a-471e-a420-06693ba8589b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:50.984955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0ffd99d6-7f5a-471e-a420-06693ba8589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:51.015389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2411fbcf-5fb0-44cd-b577-23577d65c8d4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.059483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 165/347] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:51.060574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd99d6-7f5a-471e-a420-06693ba8589b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.061176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e305a8-9e6b-498d-aab2-61c43e1aa937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.061929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e305a8-9e6b-498d-aab2-61c43e1aa937 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.066494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e305a8-9e6b-498d-aab2-61c43e1aa937 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.067745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e305a8-9e6b-498d-aab2-61c43e1aa937 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.171474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e305a8-9e6b-498d-aab2-61c43e1aa937 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.173323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e305a8-9e6b-498d-aab2-61c43e1aa937 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.194302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffd99d6-7f5a-471e-a420-06693ba8589b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.197788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.225818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.237861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466760ab-08df-4ea4-8090-0a7a76ceb6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.238795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466760ab-08df-4ea4-8090-0a7a76ceb6f7 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.239075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466760ab-08df-4ea4-8090-0a7a76ceb6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.239351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466760ab-08df-4ea4-8090-0a7a76ceb6f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.254860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466760ab-08df-4ea4-8090-0a7a76ceb6f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-466760ab-08df-4ea4-8090-0a7a76ceb6f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:51.264798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:51.265782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:51.266608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 166/348] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:51.267274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466760ab-08df-4ea4-8090-0a7a76ceb6f7 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.297708 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 183/349] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:51.298942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e305a8-9e6b-498d-aab2-61c43e1aa937 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.404498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466760ab-08df-4ea4-8090-0a7a76ceb6f7 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.439342 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e305a8-9e6b-498d-aab2-61c43e1aa937 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.456716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140af08-ea81-4c81-a8f2-f16266c82e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.456716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140af08-ea81-4c81-a8f2-f16266c82e3c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.456716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140af08-ea81-4c81-a8f2-f16266c82e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.456716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9140af08-ea81-4c81-a8f2-f16266c82e3c None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.457972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140af08-ea81-4c81-a8f2-f16266c82e3c None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.459636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9140af08-ea81-4c81-a8f2-f16266c82e3c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.461521 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 167/350] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:51.463746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140af08-ea81-4c81-a8f2-f16266c82e3c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.488196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bddee06-ea0b-47d1-bc3b-2a8ef8ab6d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.489028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddee06-ea0b-47d1-bc3b-2a8ef8ab6d6c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.489307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddee06-ea0b-47d1-bc3b-2a8ef8ab6d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.489579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bddee06-ea0b-47d1-bc3b-2a8ef8ab6d6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.499199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.501527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.505043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bddee06-ea0b-47d1-bc3b-2a8ef8ab6d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2bddee06-ea0b-47d1-bc3b-2a8ef8ab6d6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:51.513501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:51.514469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:51.515234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 184/351] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:51.516302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92efc-3097-41be-af66-8152baa7f845 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.516584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92efc-3097-41be-af66-8152baa7f845 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.516856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a92efc-3097-41be-af66-8152baa7f845 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.518250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 185/352] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:51.523140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92efc-3097-41be-af66-8152baa7f845 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.593885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9140af08-ea81-4c81-a8f2-f16266c82e3c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.642665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f43762-15f3-4622-9ba4-31cf55da30e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.643339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f43762-15f3-4622-9ba4-31cf55da30e4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.643619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f43762-15f3-4622-9ba4-31cf55da30e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.643895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f43762-15f3-4622-9ba4-31cf55da30e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.645179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f43762-15f3-4622-9ba4-31cf55da30e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:51.645486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f43762-15f3-4622-9ba4-31cf55da30e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.647247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f43762-15f3-4622-9ba4-31cf55da30e4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.659122 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 168/353] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:51.660226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f43762-15f3-4622-9ba4-31cf55da30e4 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.667857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a92efc-3097-41be-af66-8152baa7f845 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.710187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf4d46-057b-42f3-b52c-c253f0c0fefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.710978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf4d46-057b-42f3-b52c-c253f0c0fefc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.711286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf4d46-057b-42f3-b52c-c253f0c0fefc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.711564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf4d46-057b-42f3-b52c-c253f0c0fefc None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.712759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf4d46-057b-42f3-b52c-c253f0c0fefc None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.714534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf4d46-057b-42f3-b52c-c253f0c0fefc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.715940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 186/354] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:51.716702 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf4d46-057b-42f3-b52c-c253f0c0fefc None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.773551 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.780989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f43762-15f3-4622-9ba4-31cf55da30e4 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.807665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:51.821980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f702b-7cd4-4752-bf02-4fd982522596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.822883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f702b-7cd4-4752-bf02-4fd982522596 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.823164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f702b-7cd4-4752-bf02-4fd982522596 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.823440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f702b-7cd4-4752-bf02-4fd982522596 None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.830803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f702b-7cd4-4752-bf02-4fd982522596 None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.832823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f702b-7cd4-4752-bf02-4fd982522596 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.834541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 169/355] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:51.835730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0c9d2-cc83-41d8-9590-a52ac794d062 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.836053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0c9d2-cc83-41d8-9590-a52ac794d062 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.836276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd0c9d2-cc83-41d8-9590-a52ac794d062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.856252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf4d46-057b-42f3-b52c-c253f0c0fefc None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:51.861523 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-ecd0c9d2-cc83-41d8-9590-a52ac794d062 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:51.862735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ecd0c9d2-cc83-41d8-9590-a52ac794d062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:51.901498 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f2fa-6e1c-4d2a-bc4e-bd76b9de9d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:51.902190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f2fa-6e1c-4d2a-bc4e-bd76b9de9d82 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:51.902468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f2fa-6e1c-4d2a-bc4e-bd76b9de9d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:51.902731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f2fa-6e1c-4d2a-bc4e-bd76b9de9d82 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:51.903482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29f2fa-6e1c-4d2a-bc4e-bd76b9de9d82 None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:51.903786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29f2fa-6e1c-4d2a-bc4e-bd76b9de9d82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:51.905157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29f2fa-6e1c-4d2a-bc4e-bd76b9de9d82 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:51.914573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 187/356] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:51.915210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f2fa-6e1c-4d2a-bc4e-bd76b9de9d82 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:51.949591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 170/357] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:51.949591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0c9d2-cc83-41d8-9590-a52ac794d062 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:52.035713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f2fa-6e1c-4d2a-bc4e-bd76b9de9d82 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:52.065106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:52.071267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:52.077818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105d779-9b7e-44b2-8e08-51533a502337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:52.078004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd0c9d2-cc83-41d8-9590-a52ac794d062 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:52.078738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105d779-9b7e-44b2-8e08-51533a502337 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.079025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105d779-9b7e-44b2-8e08-51533a502337 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.079306 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105d779-9b7e-44b2-8e08-51533a502337 None admin] PATH_INFO: `/v3/users/98631608a63c49b2821f27649871c856` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.081132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105d779-9b7e-44b2-8e08-51533a502337 None admin] RBAC: Authorizing `identity:get_user(user_id=98631608a63c49b2821f27649871c856)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:52.083612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5105d779-9b7e-44b2-8e08-51533a502337 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:52.085484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 188/358] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/users/98631608a63c49b2821f27649871c856 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:52.087228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7c3b-1743-4cab-926a-aadc3c52850d None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.087513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7c3b-1743-4cab-926a-aadc3c52850d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.087797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7c3b-1743-4cab-926a-aadc3c52850d None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.090343 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 189/359] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:52.090914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d7c3b-1743-4cab-926a-aadc3c52850d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:52.116949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b636043-cb79-480b-a8a6-015e1c6f7015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:52.117814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b636043-cb79-480b-a8a6-015e1c6f7015 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.118109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b636043-cb79-480b-a8a6-015e1c6f7015 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.118392 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b636043-cb79-480b-a8a6-015e1c6f7015 None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.119572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b636043-cb79-480b-a8a6-015e1c6f7015 None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:52.121003 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b636043-cb79-480b-a8a6-015e1c6f7015 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:52.123104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 171/360] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:28:51 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:52.123461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b636043-cb79-480b-a8a6-015e1c6f7015 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:52.215002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4d7c3b-1743-4cab-926a-aadc3c52850d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:52.236960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b636043-cb79-480b-a8a6-015e1c6f7015 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:52.256639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17665b97-56ef-46ff-b945-a0997cb34941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:52.257289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17665b97-56ef-46ff-b945-a0997cb34941 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.257569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17665b97-56ef-46ff-b945-a0997cb34941 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.257842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17665b97-56ef-46ff-b945-a0997cb34941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.258710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17665b97-56ef-46ff-b945-a0997cb34941 None admin] RBAC: Adding query filter params (group.id=28d5e0e97adc44a4ac06ba6d04cc383f, role.id=5cb95ca9624d408a80d77ecc45d0c310, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:52.259016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17665b97-56ef-46ff-b945-a0997cb34941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:52.260721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17665b97-56ef-46ff-b945-a0997cb34941 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:52.267313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 190/361] 10.222.0.79 () {56 vars in 1376 bytes} [Wed May 25 14:28:52 2022] GET /identity/v3/role_assignments?group.id=28d5e0e97adc44a4ac06ba6d04cc383f&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=5cb95ca9624d408a80d77ecc45d0c310 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:52.268502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17665b97-56ef-46ff-b945-a0997cb34941 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:52.279571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05d64d7-c633-41ba-b6df-841b639ccc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:52.280247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d64d7-c633-41ba-b6df-841b639ccc19 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.280530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d64d7-c633-41ba-b6df-841b639ccc19 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.280807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05d64d7-c633-41ba-b6df-841b639ccc19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.314616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:52.362917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:52.373843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d64d7-c633-41ba-b6df-841b639ccc19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:52.375432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05d64d7-c633-41ba-b6df-841b639ccc19 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:52.419611 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17665b97-56ef-46ff-b945-a0997cb34941 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:52.466413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea77a2-b0c5-4eed-9a51-2cc543508998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:52.467254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea77a2-b0c5-4eed-9a51-2cc543508998 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.467541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea77a2-b0c5-4eed-9a51-2cc543508998 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.467821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea77a2-b0c5-4eed-9a51-2cc543508998 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.480067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea77a2-b0c5-4eed-9a51-2cc543508998 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-51ea77a2-b0c5-4eed-9a51-2cc543508998 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:52.488918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:52.489821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:52.490635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 191/362] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:52.491285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea77a2-b0c5-4eed-9a51-2cc543508998 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:52.511974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 172/363] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:52.513432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a950-eaaf-4b89-b464-533370f60c06 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.513822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a950-eaaf-4b89-b464-533370f60c06 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.514367 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0a950-eaaf-4b89-b464-533370f60c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.535834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d5a0a950-eaaf-4b89-b464-533370f60c06 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:52.537868 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d5a0a950-eaaf-4b89-b464-533370f60c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:52.600959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:52.624607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 173/364] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:52.625729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a950-eaaf-4b89-b464-533370f60c06 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:52.643890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea77a2-b0c5-4eed-9a51-2cc543508998 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:52.675736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:52.690925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0b54e-f926-4b30-85db-f612723667cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:52.691690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0b54e-f926-4b30-85db-f612723667cf None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.691969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0b54e-f926-4b30-85db-f612723667cf None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.692245 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda0b54e-f926-4b30-85db-f612723667cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.693079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0b54e-f926-4b30-85db-f612723667cf None admin] RBAC: Adding query filter params (role.id=e6190de07af44357a40a6be75cf7431c, user.id=98631608a63c49b2821f27649871c856, scope.system=all) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:52.693391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0b54e-f926-4b30-85db-f612723667cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:52.694862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda0b54e-f926-4b30-85db-f612723667cf None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:52.707695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 192/365] 10.222.0.79 () {56 vars in 1308 bytes} [Wed May 25 14:28:52 2022] GET /identity/v3/role_assignments?user.id=98631608a63c49b2821f27649871c856&scope.system=all&role.id=e6190de07af44357a40a6be75cf7431c => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:52.708509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0b54e-f926-4b30-85db-f612723667cf None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:52.759043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0a950-eaaf-4b89-b464-533370f60c06 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:52.819954 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922dca6-330f-43df-afee-471a7e97afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:52.820632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922dca6-330f-43df-afee-471a7e97afe3 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.820964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922dca6-330f-43df-afee-471a7e97afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.821251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922dca6-330f-43df-afee-471a7e97afe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.822192 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922dca6-330f-43df-afee-471a7e97afe3 None admin] RBAC: Adding query filter params (group.id=28d5e0e97adc44a4ac06ba6d04cc383f, role.id=faabf98abc6d4899b452e792928050ca, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:52.822716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922dca6-330f-43df-afee-471a7e97afe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:52.823993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922dca6-330f-43df-afee-471a7e97afe3 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:52.831569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 174/366] 10.222.0.79 () {56 vars in 1376 bytes} [Wed May 25 14:28:52 2022] GET /identity/v3/role_assignments?group.id=28d5e0e97adc44a4ac06ba6d04cc383f&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=faabf98abc6d4899b452e792928050ca => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:52.832368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922dca6-330f-43df-afee-471a7e97afe3 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:52.841304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda0b54e-f926-4b30-85db-f612723667cf None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:52.898508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:52.939860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aab80a-2be6-4d57-a5fe-191dc57f8d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:52.940653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aab80a-2be6-4d57-a5fe-191dc57f8d75 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:52.940943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aab80a-2be6-4d57-a5fe-191dc57f8d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:52.941357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aab80a-2be6-4d57-a5fe-191dc57f8d75 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:52.942157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aab80a-2be6-4d57-a5fe-191dc57f8d75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:52.942473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aab80a-2be6-4d57-a5fe-191dc57f8d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:52.943898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aab80a-2be6-4d57-a5fe-191dc57f8d75 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:52.954015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 193/367] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:52.955127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aab80a-2be6-4d57-a5fe-191dc57f8d75 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:52.958546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922dca6-330f-43df-afee-471a7e97afe3 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.001876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeba33-1609-4345-8ad3-a8becd060395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.002802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeba33-1609-4345-8ad3-a8becd060395 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.003270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeba33-1609-4345-8ad3-a8becd060395 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.003546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabeba33-1609-4345-8ad3-a8becd060395 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.005733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabeba33-1609-4345-8ad3-a8becd060395 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:53.007240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabeba33-1609-4345-8ad3-a8becd060395 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:53.009371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 175/368] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:52 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:53.015285 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeba33-1609-4345-8ad3-a8becd060395 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.016308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:53.088484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aab80a-2be6-4d57-a5fe-191dc57f8d75 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.126819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb1c1-5a57-4b4b-9262-d2e7968e3a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.127601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb1c1-5a57-4b4b-9262-d2e7968e3a04 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.127973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb1c1-5a57-4b4b-9262-d2e7968e3a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.128156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9abb1c1-5a57-4b4b-9262-d2e7968e3a04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.129818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabeba33-1609-4345-8ad3-a8becd060395 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.141466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9abb1c1-5a57-4b4b-9262-d2e7968e3a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:53.149292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a9abb1c1-5a57-4b4b-9262-d2e7968e3a04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:53.151972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:53.152983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:53.153752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:53.155099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 194/369] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:53.155099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb1c1-5a57-4b4b-9262-d2e7968e3a04 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.170120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374031c-04ad-4598-b805-57d1911557bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.170809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374031c-04ad-4598-b805-57d1911557bb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.171090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374031c-04ad-4598-b805-57d1911557bb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.171370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374031c-04ad-4598-b805-57d1911557bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.245786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374031c-04ad-4598-b805-57d1911557bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:53.247312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374031c-04ad-4598-b805-57d1911557bb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:53.278728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9abb1c1-5a57-4b4b-9262-d2e7968e3a04 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.290450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:53.317240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4425fd-fb10-4357-9d30-ecc8e49f4413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.318276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4425fd-fb10-4357-9d30-ecc8e49f4413 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.318567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4425fd-fb10-4357-9d30-ecc8e49f4413 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.318847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4425fd-fb10-4357-9d30-ecc8e49f4413 None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.320042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4425fd-fb10-4357-9d30-ecc8e49f4413 None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:53.321709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4425fd-fb10-4357-9d30-ecc8e49f4413 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:53.323711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 195/370] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:53.324155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4425fd-fb10-4357-9d30-ecc8e49f4413 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.357627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 176/371] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:53.359139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374031c-04ad-4598-b805-57d1911557bb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.378571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:53.437270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4425fd-fb10-4357-9d30-ecc8e49f4413 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.467559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374031c-04ad-4598-b805-57d1911557bb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.476655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59361c09-79f4-407b-a8a7-49a83fa96f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.477341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59361c09-79f4-407b-a8a7-49a83fa96f60 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.477625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59361c09-79f4-407b-a8a7-49a83fa96f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.478655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59361c09-79f4-407b-a8a7-49a83fa96f60 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.479416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59361c09-79f4-407b-a8a7-49a83fa96f60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:53.480138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59361c09-79f4-407b-a8a7-49a83fa96f60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:53.481841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59361c09-79f4-407b-a8a7-49a83fa96f60 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:53.493900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 196/372] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:53.495469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59361c09-79f4-407b-a8a7-49a83fa96f60 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.511224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cda855-69df-414d-85b4-919c6e2c8ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.511996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cda855-69df-414d-85b4-919c6e2c8ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.512349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cda855-69df-414d-85b4-919c6e2c8ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.512698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cda855-69df-414d-85b4-919c6e2c8ce9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.513602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cda855-69df-414d-85b4-919c6e2c8ce9 None admin] RBAC: Adding query filter params (group.id=28d5e0e97adc44a4ac06ba6d04cc383f, role.id=faabf98abc6d4899b452e792928050ca, scope.project.id=19b8d221fd644566a8af166462a8a3db) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:53.513915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cda855-69df-414d-85b4-919c6e2c8ce9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:53.515388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cda855-69df-414d-85b4-919c6e2c8ce9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:53.521896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 177/373] 10.222.0.79 () {56 vars in 1376 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/role_assignments?group.id=28d5e0e97adc44a4ac06ba6d04cc383f&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=faabf98abc6d4899b452e792928050ca => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:53.522903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cda855-69df-414d-85b4-919c6e2c8ce9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.542538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:53.631538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59361c09-79f4-407b-a8a7-49a83fa96f60 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.648335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:53.674398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfe715-fb39-4a62-9031-2e5abecbb368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.675348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfe715-fb39-4a62-9031-2e5abecbb368 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.675668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfe715-fb39-4a62-9031-2e5abecbb368 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.675897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cda855-69df-414d-85b4-919c6e2c8ce9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.675996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfe715-fb39-4a62-9031-2e5abecbb368 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.677234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfe715-fb39-4a62-9031-2e5abecbb368 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:53.679991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfe715-fb39-4a62-9031-2e5abecbb368 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:53.681865 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 197/374] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:53.688829 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfe715-fb39-4a62-9031-2e5abecbb368 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.717733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab20b8-eee7-4cdb-bd77-a5eee774eacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.718514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab20b8-eee7-4cdb-bd77-a5eee774eacb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.718864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab20b8-eee7-4cdb-bd77-a5eee774eacb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.719242 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab20b8-eee7-4cdb-bd77-a5eee774eacb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.817965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:53.826315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfe715-fb39-4a62-9031-2e5abecbb368 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:53.831654 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab20b8-eee7-4cdb-bd77-a5eee774eacb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:53.833180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab20b8-eee7-4cdb-bd77-a5eee774eacb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:53.884102 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd16aa0-45fe-4eb8-8d22-9076d46c22d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:53.885857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd16aa0-45fe-4eb8-8d22-9076d46c22d0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:53.886401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd16aa0-45fe-4eb8-8d22-9076d46c22d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:53.886873 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd16aa0-45fe-4eb8-8d22-9076d46c22d0 None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:53.888718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd16aa0-45fe-4eb8-8d22-9076d46c22d0 None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:53.890440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd16aa0-45fe-4eb8-8d22-9076d46c22d0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:53.892301 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 198/375] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:53.898981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd16aa0-45fe-4eb8-8d22-9076d46c22d0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:53.963332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:54.000910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 178/376] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:28:54.008230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab20b8-eee7-4cdb-bd77-a5eee774eacb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:54.094336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd16aa0-45fe-4eb8-8d22-9076d46c22d0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:54.165821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bb132-6dfa-4255-9111-fcacdb6b4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:54.166521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bb132-6dfa-4255-9111-fcacdb6b4b85 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.166655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab20b8-eee7-4cdb-bd77-a5eee774eacb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:54.166836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bb132-6dfa-4255-9111-fcacdb6b4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.167079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bb132-6dfa-4255-9111-fcacdb6b4b85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.167910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bb132-6dfa-4255-9111-fcacdb6b4b85 None admin] RBAC: Adding query filter params (group.id=28d5e0e97adc44a4ac06ba6d04cc383f, role.id=5cb95ca9624d408a80d77ecc45d0c310, scope.project.id=19b8d221fd644566a8af166462a8a3db) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:54.168222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bb132-6dfa-4255-9111-fcacdb6b4b85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:54.169686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bb132-6dfa-4255-9111-fcacdb6b4b85 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:54.184176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 199/377] 10.222.0.79 () {56 vars in 1376 bytes} [Wed May 25 14:28:53 2022] GET /identity/v3/role_assignments?group.id=28d5e0e97adc44a4ac06ba6d04cc383f&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=5cb95ca9624d408a80d77ecc45d0c310 => generated 260 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:54.205785 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b91a0-0237-4d57-a5f5-b212c92d8b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:54.206697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b91a0-0237-4d57-a5f5-b212c92d8b1e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.207014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b91a0-0237-4d57-a5f5-b212c92d8b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.207287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b91a0-0237-4d57-a5f5-b212c92d8b1e None admin] PATH_INFO: `/v3/projects/d9c7281911bf46ffacaa598981eac3c1` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.208497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b91a0-0237-4d57-a5f5-b212c92d8b1e None admin] RBAC: Authorizing `identity:get_project(project_id=d9c7281911bf46ffacaa598981eac3c1)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:54.209937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b91a0-0237-4d57-a5f5-b212c92d8b1e None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:54.216273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 179/378] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:54 2022] GET /identity/v3/projects/d9c7281911bf46ffacaa598981eac3c1 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:54.217651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bb132-6dfa-4255-9111-fcacdb6b4b85 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:54.275923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:54.352813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bb132-6dfa-4255-9111-fcacdb6b4b85 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:54.389807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610d44f-ebda-4dd7-9ed6-c6d937a53ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:54.390720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d44f-ebda-4dd7-9ed6-c6d937a53ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.391141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d44f-ebda-4dd7-9ed6-c6d937a53ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.391416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610d44f-ebda-4dd7-9ed6-c6d937a53ee3 None admin] PATH_INFO: `/v3/groups/7015d69d81dd4aeda890bded697a8290` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.397734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610d44f-ebda-4dd7-9ed6-c6d937a53ee3 None admin] RBAC: Authorizing `identity:get_group(group_id=7015d69d81dd4aeda890bded697a8290)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:54.399218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610d44f-ebda-4dd7-9ed6-c6d937a53ee3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:54.401188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 200/379] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:28:54 2022] GET /identity/v3/groups/7015d69d81dd4aeda890bded697a8290 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:54.406946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b91a0-0237-4d57-a5f5-b212c92d8b1e None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:54.507667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:54.577608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b91a0-0237-4d57-a5f5-b212c92d8b1e None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:54.622885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ddf70-8600-4b44-854f-0d4905f7cc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:54.623545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ddf70-8600-4b44-854f-0d4905f7cc2e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:54.623826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ddf70-8600-4b44-854f-0d4905f7cc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:54.624099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ddf70-8600-4b44-854f-0d4905f7cc2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:54.624932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ddf70-8600-4b44-854f-0d4905f7cc2e None admin] RBAC: Adding query filter params (group.id=7015d69d81dd4aeda890bded697a8290, role.id=308d9785120a49079e02659953a2b033, scope.project.id=d9c7281911bf46ffacaa598981eac3c1) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:54.625241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ddf70-8600-4b44-854f-0d4905f7cc2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:54.626720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ddf70-8600-4b44-854f-0d4905f7cc2e None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:54.638719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 180/380] 10.222.0.79 () {56 vars in 1376 bytes} [Wed May 25 14:28:54 2022] GET /identity/v3/role_assignments?group.id=7015d69d81dd4aeda890bded697a8290&scope.project.id=d9c7281911bf46ffacaa598981eac3c1&role.id=308d9785120a49079e02659953a2b033 => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:55.261772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a996a-80ef-4f43-b71b-f09495bd49d9 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:55.262330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a996a-80ef-4f43-b71b-f09495bd49d9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:55.262330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637a996a-80ef-4f43-b71b-f09495bd49d9 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:55.263970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 201/381] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:55.275267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f78ec3-cb80-4d77-bcd0-7dcde190e7ef None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:55.275676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f78ec3-cb80-4d77-bcd0-7dcde190e7ef None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:55.275841 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f78ec3-cb80-4d77-bcd0-7dcde190e7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:55.298067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a9f78ec3-cb80-4d77-bcd0-7dcde190e7ef None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:55.299265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a9f78ec3-cb80-4d77-bcd0-7dcde190e7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:55.387628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 181/382] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:55.421863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a996a-80ef-4f43-b71b-f09495bd49d9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:55.530552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:55.547703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637a996a-80ef-4f43-b71b-f09495bd49d9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:55.587649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ec02e-2fc5-4c4d-b840-f0fa91df7381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:55.588470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec02e-2fc5-4c4d-b840-f0fa91df7381 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:55.588753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec02e-2fc5-4c4d-b840-f0fa91df7381 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:55.589027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec02e-2fc5-4c4d-b840-f0fa91df7381 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:55.599936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ec02e-2fc5-4c4d-b840-f0fa91df7381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-475ec02e-2fc5-4c4d-b840-f0fa91df7381 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:55.608169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:55.609035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:55.610235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 202/383] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:55.615152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f78ec3-cb80-4d77-bcd0-7dcde190e7ef None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:55.673109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755db82-1523-4d2e-943e-63d8f0c0abd7 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:55.673426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755db82-1523-4d2e-943e-63d8f0c0abd7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:55.673666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6755db82-1523-4d2e-943e-63d8f0c0abd7 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:55.675063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 203/384] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:28:55.688114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef697a-1543-4c68-94ba-e8885a8cb8ae None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:55.688403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef697a-1543-4c68-94ba-e8885a8cb8ae None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:55.688683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef697a-1543-4c68-94ba-e8885a8cb8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:55.690297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:55.724570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-95ef697a-1543-4c68-94ba-e8885a8cb8ae None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:55.725765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-95ef697a-1543-4c68-94ba-e8885a8cb8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:55.763867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f78ec3-cb80-4d77-bcd0-7dcde190e7ef None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:55.830168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000385fb-4e8f-405b-b50f-73d8909edf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:55.830832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000385fb-4e8f-405b-b50f-73d8909edf8d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:55.831111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000385fb-4e8f-405b-b50f-73d8909edf8d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:55.831380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000385fb-4e8f-405b-b50f-73d8909edf8d None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:55.832257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000385fb-4e8f-405b-b50f-73d8909edf8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:55.832563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000385fb-4e8f-405b-b50f-73d8909edf8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:55.834624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000385fb-4e8f-405b-b50f-73d8909edf8d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:55.853123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 182/385] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:55.860058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000385fb-4e8f-405b-b50f-73d8909edf8d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:55.864602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 204/386] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:28:55.899506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef697a-1543-4c68-94ba-e8885a8cb8ae None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.004936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:56.022922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef697a-1543-4c68-94ba-e8885a8cb8ae None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:56.039497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000385fb-4e8f-405b-b50f-73d8909edf8d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:56.047078 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:56.094030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351272a-48ad-40f2-af4a-af4c18a55b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:56.095262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351272a-48ad-40f2-af4a-af4c18a55b92 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.095738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351272a-48ad-40f2-af4a-af4c18a55b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.096207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b351272a-48ad-40f2-af4a-af4c18a55b92 None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.098132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351272a-48ad-40f2-af4a-af4c18a55b92 None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:56.100009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b351272a-48ad-40f2-af4a-af4c18a55b92 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:56.102165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 183/387] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:28:55 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:56.107227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351272a-48ad-40f2-af4a-af4c18a55b92 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.111715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20744cf2-c74e-47da-abb5-11b06073b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:56.112127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20744cf2-c74e-47da-abb5-11b06073b0ff None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.112408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20744cf2-c74e-47da-abb5-11b06073b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.112684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20744cf2-c74e-47da-abb5-11b06073b0ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.162706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20744cf2-c74e-47da-abb5-11b06073b0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-20744cf2-c74e-47da-abb5-11b06073b0ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:56.170691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:56.171560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:56.172337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:56.182108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 205/388] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:56.192488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20744cf2-c74e-47da-abb5-11b06073b0ff None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.230724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b351272a-48ad-40f2-af4a-af4c18a55b92 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:56.266728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d8f9-7d23-4cde-b9b4-d9aa7d1de5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:56.268066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d8f9-7d23-4cde-b9b4-d9aa7d1de5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.268710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d8f9-7d23-4cde-b9b4-d9aa7d1de5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.269176 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944d8f9-7d23-4cde-b9b4-d9aa7d1de5f4 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.271199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944d8f9-7d23-4cde-b9b4-d9aa7d1de5f4 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:56.272887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1944d8f9-7d23-4cde-b9b4-d9aa7d1de5f4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:56.275279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 184/389] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:56 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:56.283109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d8f9-7d23-4cde-b9b4-d9aa7d1de5f4 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.342450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:56.346731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20744cf2-c74e-47da-abb5-11b06073b0ff None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:56.382111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635c45cb-639a-43e2-bed6-0abe2be19334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:56.383087 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c45cb-639a-43e2-bed6-0abe2be19334 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.383573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c45cb-639a-43e2-bed6-0abe2be19334 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.384022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635c45cb-639a-43e2-bed6-0abe2be19334 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.384945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c45cb-639a-43e2-bed6-0abe2be19334 None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:56.385684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c45cb-639a-43e2-bed6-0abe2be19334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:56.387402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635c45cb-639a-43e2-bed6-0abe2be19334 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:56.397043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 206/390] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:56.398635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd125-e896-4214-924b-0d2a21518da6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.399122 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd125-e896-4214-924b-0d2a21518da6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.399594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bcd125-e896-4214-924b-0d2a21518da6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.401275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 207/391] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:56.405711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd125-e896-4214-924b-0d2a21518da6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.409808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944d8f9-7d23-4cde-b9b4-d9aa7d1de5f4 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:56.420853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:56.454284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271503d-82c6-4853-bd4a-8715614edb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:56.455609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271503d-82c6-4853-bd4a-8715614edb0a None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.456607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271503d-82c6-4853-bd4a-8715614edb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.457685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271503d-82c6-4853-bd4a-8715614edb0a None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/groups/28d5e0e97adc44a4ac06ba6d04cc383f/roles/5cb95ca9624d408a80d77ecc45d0c310` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.461127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271503d-82c6-4853-bd4a-8715614edb0a None admin] RBAC: Authorizing `identity:create_grant(project_id=00b4124e2ef54662829ffdfde18ae8ba, group_id=28d5e0e97adc44a4ac06ba6d04cc383f, role_id=5cb95ca9624d408a80d77ecc45d0c310)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:56.463387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271503d-82c6-4853-bd4a-8715614edb0a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:56.482193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 185/392] 10.222.0.79 () {58 vars in 1442 bytes} [Wed May 25 14:28:56 2022] PUT /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/groups/28d5e0e97adc44a4ac06ba6d04cc383f/roles/5cb95ca9624d408a80d77ecc45d0c310 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:56.483949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936a8e-0fac-4db8-ab06-af5432da2b75 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.484405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936a8e-0fac-4db8-ab06-af5432da2b75 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.484823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1936a8e-0fac-4db8-ab06-af5432da2b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.508812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-f1936a8e-0fac-4db8-ab06-af5432da2b75 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:56.510921 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f1936a8e-0fac-4db8-ab06-af5432da2b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:56.533124 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bcd125-e896-4214-924b-0d2a21518da6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:56.573243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe8db9-84cf-47dc-99bc-caad99bb2516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:56.574861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe8db9-84cf-47dc-99bc-caad99bb2516 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.575311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe8db9-84cf-47dc-99bc-caad99bb2516 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.575737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe8db9-84cf-47dc-99bc-caad99bb2516 None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.579056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe8db9-84cf-47dc-99bc-caad99bb2516 None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:56.580632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe8db9-84cf-47dc-99bc-caad99bb2516 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:56.587812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 208/393] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:28:56 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:56.590388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe8db9-84cf-47dc-99bc-caad99bb2516 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.618685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 186/394] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:56.674481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1936a8e-0fac-4db8-ab06-af5432da2b75 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.712639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:56.716416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:56.767288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe8db9-84cf-47dc-99bc-caad99bb2516 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:56.825925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28cf94-c1f5-4451-8424-3c5691d0d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:56.826986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28cf94-c1f5-4451-8424-3c5691d0d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.827586 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28cf94-c1f5-4451-8424-3c5691d0d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.827932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28cf94-c1f5-4451-8424-3c5691d0d4b8 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.829761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28cf94-c1f5-4451-8424-3c5691d0d4b8 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:56.831932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28cf94-c1f5-4451-8424-3c5691d0d4b8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:56.842107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 209/395] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:56 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:56.842107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28cf94-c1f5-4451-8424-3c5691d0d4b8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:56.873819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1936a8e-0fac-4db8-ab06-af5432da2b75 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:56.941822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f331ee-3d0c-44de-858f-1e31e3ea5580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:56.943005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f331ee-3d0c-44de-858f-1e31e3ea5580 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.943708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f331ee-3d0c-44de-858f-1e31e3ea5580 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.945152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f331ee-3d0c-44de-858f-1e31e3ea5580 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.963924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f331ee-3d0c-44de-858f-1e31e3ea5580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-96f331ee-3d0c-44de-858f-1e31e3ea5580 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:56.973846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:56.974768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:56.976130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 187/396] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:28:56.976878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8962eb6-695b-4cda-a174-f7f885c1321c None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:56.976878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8962eb6-695b-4cda-a174-f7f885c1321c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:56.977186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8962eb6-695b-4cda-a174-f7f885c1321c None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:56.978677 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 188/397] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:56.982984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8962eb6-695b-4cda-a174-f7f885c1321c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.009004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28cf94-c1f5-4451-8424-3c5691d0d4b8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.050860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cfb95-cfa3-4d06-8368-52ef010fa411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.051796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cfb95-cfa3-4d06-8368-52ef010fa411 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.052081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cfb95-cfa3-4d06-8368-52ef010fa411 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.052360 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cfb95-cfa3-4d06-8368-52ef010fa411 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/groups/28d5e0e97adc44a4ac06ba6d04cc383f/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.055033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cfb95-cfa3-4d06-8368-52ef010fa411 None admin] RBAC: Authorizing `identity:create_grant(project_id=00b4124e2ef54662829ffdfde18ae8ba, group_id=28d5e0e97adc44a4ac06ba6d04cc383f, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.056827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cfb95-cfa3-4d06-8368-52ef010fa411 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.082225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 210/398] 10.222.0.79 () {58 vars in 1442 bytes} [Wed May 25 14:28:56 2022] PUT /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba/groups/28d5e0e97adc44a4ac06ba6d04cc383f/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:28:57.082225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb77d6-3940-4a9a-9a02-d95a076b6c9d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.082225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb77d6-3940-4a9a-9a02-d95a076b6c9d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.082225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb77d6-3940-4a9a-9a02-d95a076b6c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.089512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.099190 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.104743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-edbb77d6-3940-4a9a-9a02-d95a076b6c9d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:57.106417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-edbb77d6-3940-4a9a-9a02-d95a076b6c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:57.110983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8962eb6-695b-4cda-a174-f7f885c1321c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.153210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387c837-2f42-40f5-a126-bc46adb0e1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.153812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c837-2f42-40f5-a126-bc46adb0e1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.154116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c837-2f42-40f5-a126-bc46adb0e1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.154403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387c837-2f42-40f5-a126-bc46adb0e1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.155174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387c837-2f42-40f5-a126-bc46adb0e1c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:57.155486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387c837-2f42-40f5-a126-bc46adb0e1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.156983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e387c837-2f42-40f5-a126-bc46adb0e1c7 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.173578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 189/399] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:28:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:57.175129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ecd72-4df4-4e75-8fc6-bc1ddcea9d2c None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.175509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ecd72-4df4-4e75-8fc6-bc1ddcea9d2c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.175843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ecd72-4df4-4e75-8fc6-bc1ddcea9d2c None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.181918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 190/400] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:57.181918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ecd72-4df4-4e75-8fc6-bc1ddcea9d2c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.199134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 211/401] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:57.206511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8562-d447-4b32-8072-677190594096 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.206924 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8562-d447-4b32-8072-677190594096 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.207152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c8562-d447-4b32-8072-677190594096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.240231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-270c8562-d447-4b32-8072-677190594096 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:57.241451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-270c8562-d447-4b32-8072-677190594096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:57.322961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ecd72-4df4-4e75-8fc6-bc1ddcea9d2c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.329654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 212/402] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:57.330811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8562-d447-4b32-8072-677190594096 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.361182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621fbc8-61c8-4a67-b6a1-ed9fc72ecd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.362143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621fbc8-61c8-4a67-b6a1-ed9fc72ecd1f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.362426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621fbc8-61c8-4a67-b6a1-ed9fc72ecd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.362859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621fbc8-61c8-4a67-b6a1-ed9fc72ecd1f None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.364112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621fbc8-61c8-4a67-b6a1-ed9fc72ecd1f None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.365580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9621fbc8-61c8-4a67-b6a1-ed9fc72ecd1f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.367510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 191/403] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:57.368411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621fbc8-61c8-4a67-b6a1-ed9fc72ecd1f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.394702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.418355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.467706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c8562-d447-4b32-8072-677190594096 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.488584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621fbc8-61c8-4a67-b6a1-ed9fc72ecd1f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.514871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f0c0b-2602-4b3c-85cf-df81a4bc9b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.516238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f0c0b-2602-4b3c-85cf-df81a4bc9b76 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.516525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f0c0b-2602-4b3c-85cf-df81a4bc9b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.517088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f0c0b-2602-4b3c-85cf-df81a4bc9b76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.529988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdf3c1-c2b8-4839-b5a4-8322717ed597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.530811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f0c0b-2602-4b3c-85cf-df81a4bc9b76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:57.530940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdf3c1-c2b8-4839-b5a4-8322717ed597 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.531116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdf3c1-c2b8-4839-b5a4-8322717ed597 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.531392 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cdf3c1-c2b8-4839-b5a4-8322717ed597 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-251f0c0b-2602-4b3c-85cf-df81a4bc9b76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:57.541201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:57.542047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:57.542830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:28:57.543855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cdf3c1-c2b8-4839-b5a4-8322717ed597 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:57.543925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 213/404] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:57.543925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f0c0b-2602-4b3c-85cf-df81a4bc9b76 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-c1cdf3c1-c2b8-4839-b5a4-8322717ed597 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:57.551843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:57.552735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:57.553501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 192/405] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:57.554943 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdf3c1-c2b8-4839-b5a4-8322717ed597 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.641350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.667164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cdf3c1-c2b8-4839-b5a4-8322717ed597 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.679980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f0c0b-2602-4b3c-85cf-df81a4bc9b76 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.703271 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cec37-2c51-4f65-9a3b-8dfd2af82ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.704697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cec37-2c51-4f65-9a3b-8dfd2af82ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.705434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cec37-2c51-4f65-9a3b-8dfd2af82ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.705915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cec37-2c51-4f65-9a3b-8dfd2af82ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.707578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cec37-2c51-4f65-9a3b-8dfd2af82ce9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:57.708032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.708312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cec37-2c51-4f65-9a3b-8dfd2af82ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.710565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34cec37-2c51-4f65-9a3b-8dfd2af82ce9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.721028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 193/406] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:57.721560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f959fa0-3d02-4118-a37a-d18cfb393808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.722396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cec37-2c51-4f65-9a3b-8dfd2af82ce9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.722530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959fa0-3d02-4118-a37a-d18cfb393808 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.722782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959fa0-3d02-4118-a37a-d18cfb393808 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.723057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f959fa0-3d02-4118-a37a-d18cfb393808 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.724253 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f959fa0-3d02-4118-a37a-d18cfb393808 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.725707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f959fa0-3d02-4118-a37a-d18cfb393808 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.733136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 214/407] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:57.733136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f959fa0-3d02-4118-a37a-d18cfb393808 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.843239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cec37-2c51-4f65-9a3b-8dfd2af82ce9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.875740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f959fa0-3d02-4118-a37a-d18cfb393808 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:57.885063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91ec00-6c59-4cbc-8af0-d76551298f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.885744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91ec00-6c59-4cbc-8af0-d76551298f77 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.886027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91ec00-6c59-4cbc-8af0-d76551298f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.886336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91ec00-6c59-4cbc-8af0-d76551298f77 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.887090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91ec00-6c59-4cbc-8af0-d76551298f77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:57.887397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91ec00-6c59-4cbc-8af0-d76551298f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.888780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91ec00-6c59-4cbc-8af0-d76551298f77 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.898417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 194/408] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:57.898953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91ec00-6c59-4cbc-8af0-d76551298f77 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.913186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:57.919457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ab32e-d0b2-472e-b982-880298d1826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:57.920431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ab32e-d0b2-472e-b982-880298d1826e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:57.920812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ab32e-d0b2-472e-b982-880298d1826e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:57.921182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ab32e-d0b2-472e-b982-880298d1826e None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:57.923204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ab32e-d0b2-472e-b982-880298d1826e None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:57.925902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78ab32e-d0b2-472e-b982-880298d1826e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:57.932626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 215/409] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:57.933733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ab32e-d0b2-472e-b982-880298d1826e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:57.999191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:58.012272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91ec00-6c59-4cbc-8af0-d76551298f77 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.047124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682332-5d25-4730-b866-9fd2cfbddcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.048043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ab32e-d0b2-472e-b982-880298d1826e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.048568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682332-5d25-4730-b866-9fd2cfbddcb5 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.049026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682332-5d25-4730-b866-9fd2cfbddcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.049472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82682332-5d25-4730-b866-9fd2cfbddcb5 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db/groups/28d5e0e97adc44a4ac06ba6d04cc383f/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.051688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82682332-5d25-4730-b866-9fd2cfbddcb5 None admin] RBAC: Authorizing `identity:create_grant(project_id=19b8d221fd644566a8af166462a8a3db, group_id=28d5e0e97adc44a4ac06ba6d04cc383f, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.053328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82682332-5d25-4730-b866-9fd2cfbddcb5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.073135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 195/410] 10.222.0.79 () {58 vars in 1442 bytes} [Wed May 25 14:28:57 2022] PUT /identity/v3/projects/19b8d221fd644566a8af166462a8a3db/groups/28d5e0e97adc44a4ac06ba6d04cc383f/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:58.074544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682332-5d25-4730-b866-9fd2cfbddcb5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:58.088599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3dcf-7d8b-4ccc-82ff-3911b41cc1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.089765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3dcf-7d8b-4ccc-82ff-3911b41cc1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.090031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3dcf-7d8b-4ccc-82ff-3911b41cc1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.090474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3dcf-7d8b-4ccc-82ff-3911b41cc1b9 None admin] PATH_INFO: `/v3/groups/7015d69d81dd4aeda890bded697a8290` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.091904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3dcf-7d8b-4ccc-82ff-3911b41cc1b9 None admin] RBAC: Authorizing `identity:get_group(group_id=7015d69d81dd4aeda890bded697a8290)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.093513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3dcf-7d8b-4ccc-82ff-3911b41cc1b9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.095809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 216/411] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:28:57 2022] GET /identity/v3/groups/7015d69d81dd4aeda890bded697a8290 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:58.101477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3dcf-7d8b-4ccc-82ff-3911b41cc1b9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:58.159739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:58.227994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82682332-5d25-4730-b866-9fd2cfbddcb5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.277377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936d278-5c4c-43bd-8d53-229d5ceafc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.278664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936d278-5c4c-43bd-8d53-229d5ceafc44 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.279164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936d278-5c4c-43bd-8d53-229d5ceafc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.280360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936d278-5c4c-43bd-8d53-229d5ceafc44 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.281960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936d278-5c4c-43bd-8d53-229d5ceafc44 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.283983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1936d278-5c4c-43bd-8d53-229d5ceafc44 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.287425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 196/412] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:58 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:58.292608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936d278-5c4c-43bd-8d53-229d5ceafc44 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:58.312635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3dcf-7d8b-4ccc-82ff-3911b41cc1b9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.345630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:58.351903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0906c-c050-492f-9744-553bb0a10a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.352790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0906c-c050-492f-9744-553bb0a10a66 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.353065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0906c-c050-492f-9744-553bb0a10a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.353347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a0906c-c050-492f-9744-553bb0a10a66 None admin] PATH_INFO: `/v3/projects/d9c7281911bf46ffacaa598981eac3c1` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.354721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0906c-c050-492f-9744-553bb0a10a66 None admin] RBAC: Authorizing `identity:get_project(project_id=d9c7281911bf46ffacaa598981eac3c1)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.356804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a0906c-c050-492f-9744-553bb0a10a66 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.359123 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 217/413] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:28:58 2022] GET /identity/v3/projects/d9c7281911bf46ffacaa598981eac3c1 => generated 344 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:58.371282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0906c-c050-492f-9744-553bb0a10a66 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:58.451799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1936d278-5c4c-43bd-8d53-229d5ceafc44 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.511359 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea28d2f-ea84-4b6f-ac34-6f1d4e9e6d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.512165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28d2f-ea84-4b6f-ac34-6f1d4e9e6d12 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.512446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28d2f-ea84-4b6f-ac34-6f1d4e9e6d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.512721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28d2f-ea84-4b6f-ac34-6f1d4e9e6d12 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db/groups/28d5e0e97adc44a4ac06ba6d04cc383f/roles/5cb95ca9624d408a80d77ecc45d0c310` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.515803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea28d2f-ea84-4b6f-ac34-6f1d4e9e6d12 None admin] RBAC: Authorizing `identity:create_grant(project_id=19b8d221fd644566a8af166462a8a3db, group_id=28d5e0e97adc44a4ac06ba6d04cc383f, role_id=5cb95ca9624d408a80d77ecc45d0c310)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.517250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea28d2f-ea84-4b6f-ac34-6f1d4e9e6d12 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.522552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:58.543159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 197/414] 10.222.0.79 () {58 vars in 1442 bytes} [Wed May 25 14:28:58 2022] PUT /identity/v3/projects/19b8d221fd644566a8af166462a8a3db/groups/28d5e0e97adc44a4ac06ba6d04cc383f/roles/5cb95ca9624d408a80d77ecc45d0c310 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:28:58.552043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a0906c-c050-492f-9744-553bb0a10a66 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:58.591118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601648e4-c9d1-4c20-bb4b-6113daafffb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:58.592360 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601648e4-c9d1-4c20-bb4b-6113daafffb1 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:58.592854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601648e4-c9d1-4c20-bb4b-6113daafffb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:58.593404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601648e4-c9d1-4c20-bb4b-6113daafffb1 None admin] PATH_INFO: `/v3/projects/d9c7281911bf46ffacaa598981eac3c1/groups/7015d69d81dd4aeda890bded697a8290/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:58.596866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601648e4-c9d1-4c20-bb4b-6113daafffb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d9c7281911bf46ffacaa598981eac3c1, group_id=7015d69d81dd4aeda890bded697a8290, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:58.600283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601648e4-c9d1-4c20-bb4b-6113daafffb1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:58.618906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 218/415] 10.222.0.79 () {58 vars in 1442 bytes} [Wed May 25 14:28:58 2022] PUT /identity/v3/projects/d9c7281911bf46ffacaa598981eac3c1/groups/7015d69d81dd4aeda890bded697a8290/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:28:59.123390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e107e-7d1e-4009-8789-7b5c98dc5207 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.123738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e107e-7d1e-4009-8789-7b5c98dc5207 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.123853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e107e-7d1e-4009-8789-7b5c98dc5207 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.125480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 198/416] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:59.131428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644bf2e-d8e8-4a49-afc3-4aea17c002de None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.131721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644bf2e-d8e8-4a49-afc3-4aea17c002de None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.132001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e644bf2e-d8e8-4a49-afc3-4aea17c002de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.155103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e644bf2e-d8e8-4a49-afc3-4aea17c002de None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:59.156299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e644bf2e-d8e8-4a49-afc3-4aea17c002de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:59.222362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:59.241436 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 219/417] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:59.276487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e107e-7d1e-4009-8789-7b5c98dc5207 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:59.414743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e107e-7d1e-4009-8789-7b5c98dc5207 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:59.463695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe23a71-c9d2-4a8b-8cce-503b5b69a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:59.464510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23a71-c9d2-4a8b-8cce-503b5b69a773 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.464790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23a71-c9d2-4a8b-8cce-503b5b69a773 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.465063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe23a71-c9d2-4a8b-8cce-503b5b69a773 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.482968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe23a71-c9d2-4a8b-8cce-503b5b69a773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-afe23a71-c9d2-4a8b-8cce-503b5b69a773 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:28:59.505295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:28:59.506244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:28:59.507036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 199/418] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:28:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:28:59.514348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644bf2e-d8e8-4a49-afc3-4aea17c002de None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:59.523060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955c63-a3a8-4437-9d1a-2f7c71b1b757 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.523343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955c63-a3a8-4437-9d1a-2f7c71b1b757 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.523589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b955c63-a3a8-4437-9d1a-2f7c71b1b757 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.527256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 200/419] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:28:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:28:59.531727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f955f2-6cd2-41f5-a32a-c5772cc70bee None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.532013 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f955f2-6cd2-41f5-a32a-c5772cc70bee None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.532285 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f955f2-6cd2-41f5-a32a-c5772cc70bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.561351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-94f955f2-6cd2-41f5-a32a-c5772cc70bee None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:28:59.562579 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-94f955f2-6cd2-41f5-a32a-c5772cc70bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:28:59.663796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:59.682863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e644bf2e-d8e8-4a49-afc3-4aea17c002de None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:59.698925 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 201/420] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:28:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:28:59.724539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c741864-1fb3-4623-b3b1-e8b31c392f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:59.725203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c741864-1fb3-4623-b3b1-e8b31c392f99 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.725484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c741864-1fb3-4623-b3b1-e8b31c392f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.725753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c741864-1fb3-4623-b3b1-e8b31c392f99 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:28:59.726517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c741864-1fb3-4623-b3b1-e8b31c392f99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:28:59.726875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c741864-1fb3-4623-b3b1-e8b31c392f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:28:59.728307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c741864-1fb3-4623-b3b1-e8b31c392f99 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:28:59.736671 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 220/421] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:28:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:28:59.741864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f955f2-6cd2-41f5-a32a-c5772cc70bee None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:59.749848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c741864-1fb3-4623-b3b1-e8b31c392f99 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:28:59.848627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:28:59.911921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c741864-1fb3-4623-b3b1-e8b31c392f99 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:28:59.948064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b73a0-78aa-4f74-b698-04fe0ea4dabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:28:59.949063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b73a0-78aa-4f74-b698-04fe0ea4dabc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:28:59.949565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b73a0-78aa-4f74-b698-04fe0ea4dabc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:28:59.950041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b73a0-78aa-4f74-b698-04fe0ea4dabc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.025912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b73a0-78aa-4f74-b698-04fe0ea4dabc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:00.027844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b73a0-78aa-4f74-b698-04fe0ea4dabc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:00.031996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f955f2-6cd2-41f5-a32a-c5772cc70bee None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:00.090729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:00.137450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d933435-92ad-46b7-8ec7-5479fc812e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:00.138564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933435-92ad-46b7-8ec7-5479fc812e5e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.138989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933435-92ad-46b7-8ec7-5479fc812e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.140343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d933435-92ad-46b7-8ec7-5479fc812e5e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.174097 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d933435-92ad-46b7-8ec7-5479fc812e5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-3d933435-92ad-46b7-8ec7-5479fc812e5e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:00.194721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:00.195837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:29:00.196635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:00.197513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 221/422] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:28:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:00.198615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b73a0-78aa-4f74-b698-04fe0ea4dabc None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:00.218413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 202/423] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:28:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 477 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:00.219565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d933435-92ad-46b7-8ec7-5479fc812e5e None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:00.333892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:00.389156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b73a0-78aa-4f74-b698-04fe0ea4dabc None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:00.459981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4076d0-fcff-41cc-ab81-1b4f87f20f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:00.460783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4076d0-fcff-41cc-ab81-1b4f87f20f69 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.461065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4076d0-fcff-41cc-ab81-1b4f87f20f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.461338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4076d0-fcff-41cc-ab81-1b4f87f20f69 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.462675 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4076d0-fcff-41cc-ab81-1b4f87f20f69 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:00.464274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4076d0-fcff-41cc-ab81-1b4f87f20f69 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:00.469785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 222/424] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:29:00 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:00.475513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4076d0-fcff-41cc-ab81-1b4f87f20f69 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:00.512286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d933435-92ad-46b7-8ec7-5479fc812e5e None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:00.521690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:00.638281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe9257-929d-497d-8492-23a45c197d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:00.639206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe9257-929d-497d-8492-23a45c197d22 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.639656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe9257-929d-497d-8492-23a45c197d22 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.640074 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe9257-929d-497d-8492-23a45c197d22 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.650105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe9257-929d-497d-8492-23a45c197d22 None admin] RBAC: Adding query filter params (name=member) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:00.650670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe9257-929d-497d-8492-23a45c197d22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:00.652243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe9257-929d-497d-8492-23a45c197d22 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:00.680059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 203/425] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:29:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:00.691655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe9257-929d-497d-8492-23a45c197d22 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:00.746061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4076d0-fcff-41cc-ab81-1b4f87f20f69 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:00.830267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf439a87-79f6-4485-81eb-a27fb3d83e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:00.833609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439a87-79f6-4485-81eb-a27fb3d83e35 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.834061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439a87-79f6-4485-81eb-a27fb3d83e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.834490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf439a87-79f6-4485-81eb-a27fb3d83e35 None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.836396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf439a87-79f6-4485-81eb-a27fb3d83e35 None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:00.838207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf439a87-79f6-4485-81eb-a27fb3d83e35 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:00.841520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 223/426] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:29:00 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:00.843126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478a42a-6330-449d-afb7-ee4ed6877547 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.844983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478a42a-6330-449d-afb7-ee4ed6877547 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.846641 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6478a42a-6330-449d-afb7-ee4ed6877547 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.848868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 224/427] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:00.853899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478a42a-6330-449d-afb7-ee4ed6877547 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:00.903580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe9257-929d-497d-8492-23a45c197d22 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:00.912095 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:00.944845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec710-ed36-455d-910b-ad144dd4b1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:00.945924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec710-ed36-455d-910b-ad144dd4b1ff None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:00.946445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec710-ed36-455d-910b-ad144dd4b1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:00.947028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3ec710-ed36-455d-910b-ad144dd4b1ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:00.947879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:00.967609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6478a42a-6330-449d-afb7-ee4ed6877547 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.004191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c52a8-e04c-472f-a47e-abcb7c52d115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.004740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c52a8-e04c-472f-a47e-abcb7c52d115 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.005020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c52a8-e04c-472f-a47e-abcb7c52d115 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.005291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c52a8-e04c-472f-a47e-abcb7c52d115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.006145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c52a8-e04c-472f-a47e-abcb7c52d115 None admin] RBAC: Adding query filter params (group.id=28d5e0e97adc44a4ac06ba6d04cc383f, role.id=5cb95ca9624d408a80d77ecc45d0c310, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:01.006715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c52a8-e04c-472f-a47e-abcb7c52d115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.007969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3c52a8-e04c-472f-a47e-abcb7c52d115 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.014636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 225/428] 10.222.0.79 () {56 vars in 1376 bytes} [Wed May 25 14:29:00 2022] GET /identity/v3/role_assignments?group.id=28d5e0e97adc44a4ac06ba6d04cc383f&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=5cb95ca9624d408a80d77ecc45d0c310 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:01.015854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77df244-5e25-4eb3-a2eb-865e4ee1df8b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.016141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77df244-5e25-4eb3-a2eb-865e4ee1df8b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.016417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77df244-5e25-4eb3-a2eb-865e4ee1df8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.033399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec710-ed36-455d-910b-ad144dd4b1ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.034017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d77df244-5e25-4eb3-a2eb-865e4ee1df8b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:01.035979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d77df244-5e25-4eb3-a2eb-865e4ee1df8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:01.036380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3ec710-ed36-455d-910b-ad144dd4b1ff None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.114108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 226/429] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:01.137784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77df244-5e25-4eb3-a2eb-865e4ee1df8b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.200479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 204/430] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:01.206156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec710-ed36-455d-910b-ad144dd4b1ff None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.220936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.242948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.266247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77df244-5e25-4eb3-a2eb-865e4ee1df8b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.315155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39435cd-fe95-4362-b64c-4a822c91a85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.315988 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39435cd-fe95-4362-b64c-4a822c91a85d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.316271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39435cd-fe95-4362-b64c-4a822c91a85d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.316543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39435cd-fe95-4362-b64c-4a822c91a85d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.330451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39435cd-fe95-4362-b64c-4a822c91a85d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:01.332486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3ec710-ed36-455d-910b-ad144dd4b1ff None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f39435cd-fe95-4362-b64c-4a822c91a85d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:01.339362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:01.340692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:01.341736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 227/431] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:01.342893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1abac-dff1-4646-96bd-1f42da6d4b72 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.342893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1abac-dff1-4646-96bd-1f42da6d4b72 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.342893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1abac-dff1-4646-96bd-1f42da6d4b72 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.345249 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 228/432] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:01.351616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1abac-dff1-4646-96bd-1f42da6d4b72 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.371329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb57f1e-9331-460b-b66e-1f5820fa2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.372390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb57f1e-9331-460b-b66e-1f5820fa2e37 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.372676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb57f1e-9331-460b-b66e-1f5820fa2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.372949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb57f1e-9331-460b-b66e-1f5820fa2e37 None admin] PATH_INFO: `/v3/projects/00b4124e2ef54662829ffdfde18ae8ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.374159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb57f1e-9331-460b-b66e-1f5820fa2e37 None admin] RBAC: Authorizing `identity:get_project(project_id=00b4124e2ef54662829ffdfde18ae8ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.375604 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb57f1e-9331-460b-b66e-1f5820fa2e37 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.377308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 205/433] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/projects/00b4124e2ef54662829ffdfde18ae8ba => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:01.379090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa74f5-7af4-4663-8fbf-7f489e986f1e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.379375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa74f5-7af4-4663-8fbf-7f489e986f1e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.379645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa74f5-7af4-4663-8fbf-7f489e986f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.396127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7faa74f5-7af4-4663-8fbf-7f489e986f1e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:01.397305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7faa74f5-7af4-4663-8fbf-7f489e986f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:01.470135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 206/434] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:01.470823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa74f5-7af4-4663-8fbf-7f489e986f1e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.475381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.478647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1abac-dff1-4646-96bd-1f42da6d4b72 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.514978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c379a97-5502-49a6-83e4-3cec9d907faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.515638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379a97-5502-49a6-83e4-3cec9d907faa None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.515921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379a97-5502-49a6-83e4-3cec9d907faa None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.516190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c379a97-5502-49a6-83e4-3cec9d907faa None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.516975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c379a97-5502-49a6-83e4-3cec9d907faa None admin] RBAC: Adding query filter params (name=member) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:01.517228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c379a97-5502-49a6-83e4-3cec9d907faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.518660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c379a97-5502-49a6-83e4-3cec9d907faa None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.524143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.530428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 229/435] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:01.531602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eccd88-cadd-4f9b-ab55-7775796e82eb None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.531889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eccd88-cadd-4f9b-ab55-7775796e82eb None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.532168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eccd88-cadd-4f9b-ab55-7775796e82eb None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.533415 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 230/436] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:01.534280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eccd88-cadd-4f9b-ab55-7775796e82eb None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.574373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa74f5-7af4-4663-8fbf-7f489e986f1e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.608143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8420d-4ce3-41cf-97a0-f7cfb2e87e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.608998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8420d-4ce3-41cf-97a0-f7cfb2e87e5d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.609278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8420d-4ce3-41cf-97a0-f7cfb2e87e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.609551 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8420d-4ce3-41cf-97a0-f7cfb2e87e5d None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.610721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8420d-4ce3-41cf-97a0-f7cfb2e87e5d None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.612168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8420d-4ce3-41cf-97a0-f7cfb2e87e5d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.613794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 207/437] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:01.614586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8420d-4ce3-41cf-97a0-f7cfb2e87e5d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.635895 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eccd88-cadd-4f9b-ab55-7775796e82eb None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.670392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0863b0f-81c5-4bb2-a6a1-c5b0a3e364b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.671199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863b0f-81c5-4bb2-a6a1-c5b0a3e364b6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.671475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863b0f-81c5-4bb2-a6a1-c5b0a3e364b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.671747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863b0f-81c5-4bb2-a6a1-c5b0a3e364b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.681591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0863b0f-81c5-4bb2-a6a1-c5b0a3e364b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:01.687748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b0863b0f-81c5-4bb2-a6a1-c5b0a3e364b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:01.689813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:01.690750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:01.692079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 231/438] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:01.693178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289940f3-7670-4914-9ad2-34c696003678 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.693389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289940f3-7670-4914-9ad2-34c696003678 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.693663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289940f3-7670-4914-9ad2-34c696003678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.709906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-289940f3-7670-4914-9ad2-34c696003678 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:01.711105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-289940f3-7670-4914-9ad2-34c696003678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:01.719668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8420d-4ce3-41cf-97a0-f7cfb2e87e5d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.752101 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d2790-18d5-4628-9df4-9764739ca457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.752743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2790-18d5-4628-9df4-9764739ca457 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.753026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2790-18d5-4628-9df4-9764739ca457 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.753299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d2790-18d5-4628-9df4-9764739ca457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.765591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.777453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 232/439] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:01.778306 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289940f3-7670-4914-9ad2-34c696003678 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.824152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d2790-18d5-4628-9df4-9764739ca457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.825630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50d2790-18d5-4628-9df4-9764739ca457 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.878914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289940f3-7670-4914-9ad2-34c696003678 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:01.894990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:01.912642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731178c-26b0-4ea3-b3c5-a1c824a039f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:01.913291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731178c-26b0-4ea3-b3c5-a1c824a039f0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:01.913574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731178c-26b0-4ea3-b3c5-a1c824a039f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:01.913847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731178c-26b0-4ea3-b3c5-a1c824a039f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:01.914715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731178c-26b0-4ea3-b3c5-a1c824a039f0 None admin] RBAC: Adding query filter params (group.id=28d5e0e97adc44a4ac06ba6d04cc383f, role.id=faabf98abc6d4899b452e792928050ca, scope.project.id=00b4124e2ef54662829ffdfde18ae8ba) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:01.915026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731178c-26b0-4ea3-b3c5-a1c824a039f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:01.916457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731178c-26b0-4ea3-b3c5-a1c824a039f0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:01.922167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 233/440] 10.222.0.79 () {56 vars in 1376 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/role_assignments?group.id=28d5e0e97adc44a4ac06ba6d04cc383f&scope.project.id=00b4124e2ef54662829ffdfde18ae8ba&role.id=faabf98abc6d4899b452e792928050ca => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:01.922941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731178c-26b0-4ea3-b3c5-a1c824a039f0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.926529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 208/441] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:01.927224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d2790-18d5-4628-9df4-9764739ca457 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:01.985447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.035776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50d2790-18d5-4628-9df4-9764739ca457 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.040959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731178c-26b0-4ea3-b3c5-a1c824a039f0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.073656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265431d-249d-4de1-beea-f2310f89f43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.074493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265431d-249d-4de1-beea-f2310f89f43c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.074776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265431d-249d-4de1-beea-f2310f89f43c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.075060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f265431d-249d-4de1-beea-f2310f89f43c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.080486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19ead7-d9eb-4144-ab85-041440fdbc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.081389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19ead7-d9eb-4144-ab85-041440fdbc64 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.082377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19ead7-d9eb-4144-ab85-041440fdbc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.082960 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19ead7-d9eb-4144-ab85-041440fdbc64 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.084028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19ead7-d9eb-4144-ab85-041440fdbc64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:02.084511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19ead7-d9eb-4144-ab85-041440fdbc64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.086093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19ead7-d9eb-4144-ab85-041440fdbc64 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.086710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f265431d-249d-4de1-beea-f2310f89f43c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-f265431d-249d-4de1-beea-f2310f89f43c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:02.094736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:02.095871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:02.096646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 209/442] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:02.097883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265431d-249d-4de1-beea-f2310f89f43c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.103181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 234/443] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:02.103181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19ead7-d9eb-4144-ab85-041440fdbc64 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.136730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.216678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19ead7-d9eb-4144-ab85-041440fdbc64 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.221698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f265431d-249d-4de1-beea-f2310f89f43c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.235593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.257332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3759-6688-4f64-bae4-fca6a0e68f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.258006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3759-6688-4f64-bae4-fca6a0e68f36 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.258317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3759-6688-4f64-bae4-fca6a0e68f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.258597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63a3759-6688-4f64-bae4-fca6a0e68f36 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.259354 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a3759-6688-4f64-bae4-fca6a0e68f36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:02.259659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a3759-6688-4f64-bae4-fca6a0e68f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.261294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63a3759-6688-4f64-bae4-fca6a0e68f36 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.263707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a7d3b-7227-417a-8bd2-bb031a337234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.264583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7d3b-7227-417a-8bd2-bb031a337234 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.264865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7d3b-7227-417a-8bd2-bb031a337234 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.265139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a7d3b-7227-417a-8bd2-bb031a337234 None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.266366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a7d3b-7227-417a-8bd2-bb031a337234 None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.267900 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a7d3b-7227-417a-8bd2-bb031a337234 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.270218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 235/444] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:02.271022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3759-6688-4f64-bae4-fca6a0e68f36 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.271543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 210/445] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:02.277992 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a7d3b-7227-417a-8bd2-bb031a337234 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.387126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63a3759-6688-4f64-bae4-fca6a0e68f36 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.398771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.407156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a7d3b-7227-417a-8bd2-bb031a337234 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.426931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff0113-734f-45ef-b3e9-56d57d111bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.427580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff0113-734f-45ef-b3e9-56d57d111bbd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.427861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff0113-734f-45ef-b3e9-56d57d111bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.428136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ff0113-734f-45ef-b3e9-56d57d111bbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.445380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee903a-8254-412f-83fb-197ca0e4fd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.446650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee903a-8254-412f-83fb-197ca0e4fd64 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.447101 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee903a-8254-412f-83fb-197ca0e4fd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.447526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee903a-8254-412f-83fb-197ca0e4fd64 None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.448901 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee903a-8254-412f-83fb-197ca0e4fd64 None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.450394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee903a-8254-412f-83fb-197ca0e4fd64 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.452022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 211/446] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:02.452790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee903a-8254-412f-83fb-197ca0e4fd64 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.480939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.502768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff0113-734f-45ef-b3e9-56d57d111bbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.504782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ff0113-734f-45ef-b3e9-56d57d111bbd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.554046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee903a-8254-412f-83fb-197ca0e4fd64 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.587228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724657d0-5035-4121-9b2f-3f9e8d6a0a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.587907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724657d0-5035-4121-9b2f-3f9e8d6a0a48 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.588218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724657d0-5035-4121-9b2f-3f9e8d6a0a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.588447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724657d0-5035-4121-9b2f-3f9e8d6a0a48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.606278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 236/447] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:02.606278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff0113-734f-45ef-b3e9-56d57d111bbd None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.622791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.657468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724657d0-5035-4121-9b2f-3f9e8d6a0a48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.658967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724657d0-5035-4121-9b2f-3f9e8d6a0a48 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.679463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.702248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ff0113-734f-45ef-b3e9-56d57d111bbd None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.735324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606b815-5703-45e3-95ff-c51426162164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.735966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606b815-5703-45e3-95ff-c51426162164 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.736267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606b815-5703-45e3-95ff-c51426162164 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.736541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606b815-5703-45e3-95ff-c51426162164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.737371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606b815-5703-45e3-95ff-c51426162164 None admin] RBAC: Adding query filter params (group.id=28d5e0e97adc44a4ac06ba6d04cc383f, role.id=faabf98abc6d4899b452e792928050ca, scope.project.id=19b8d221fd644566a8af166462a8a3db) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:02.737686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606b815-5703-45e3-95ff-c51426162164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.739254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606b815-5703-45e3-95ff-c51426162164 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.744918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 237/448] 10.222.0.79 () {56 vars in 1376 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/role_assignments?group.id=28d5e0e97adc44a4ac06ba6d04cc383f&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=faabf98abc6d4899b452e792928050ca => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:02.745683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606b815-5703-45e3-95ff-c51426162164 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.766524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 212/449] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:02.773071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724657d0-5035-4121-9b2f-3f9e8d6a0a48 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.846533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.875958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606b815-5703-45e3-95ff-c51426162164 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.887617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724657d0-5035-4121-9b2f-3f9e8d6a0a48 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:02.914366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7a584-7f79-4c55-bdd4-b31a2c882e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.915282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7a584-7f79-4c55-bdd4-b31a2c882e6e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.915645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7a584-7f79-4c55-bdd4-b31a2c882e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.915990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7a584-7f79-4c55-bdd4-b31a2c882e6e None admin] PATH_INFO: `/v3/projects/19b8d221fd644566a8af166462a8a3db` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.917298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7a584-7f79-4c55-bdd4-b31a2c882e6e None admin] RBAC: Authorizing `identity:get_project(project_id=19b8d221fd644566a8af166462a8a3db)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.918818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7a584-7f79-4c55-bdd4-b31a2c882e6e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.925181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 238/450] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/projects/19b8d221fd644566a8af166462a8a3db => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:02.926578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7a584-7f79-4c55-bdd4-b31a2c882e6e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:02.928580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350ccce-c712-49b1-93c3-63a8f5d22f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:02.929067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350ccce-c712-49b1-93c3-63a8f5d22f63 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:02.929351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350ccce-c712-49b1-93c3-63a8f5d22f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:02.930402 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350ccce-c712-49b1-93c3-63a8f5d22f63 None admin] PATH_INFO: `/v3/projects/d9c7281911bf46ffacaa598981eac3c1` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:02.932169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350ccce-c712-49b1-93c3-63a8f5d22f63 None admin] RBAC: Authorizing `identity:get_project(project_id=d9c7281911bf46ffacaa598981eac3c1)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:02.934814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350ccce-c712-49b1-93c3-63a8f5d22f63 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:02.935534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 213/451] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/projects/d9c7281911bf46ffacaa598981eac3c1 => generated 344 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:02.940174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:02.940937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350ccce-c712-49b1-93c3-63a8f5d22f63 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:03.049838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7a584-7f79-4c55-bdd4-b31a2c882e6e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.059464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350ccce-c712-49b1-93c3-63a8f5d22f63 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.097813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7d5c2-e7c3-46a5-9e2e-bb3053636a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.098760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d5c2-e7c3-46a5-9e2e-bb3053636a8a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.099042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d5c2-e7c3-46a5-9e2e-bb3053636a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.099319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7d5c2-e7c3-46a5-9e2e-bb3053636a8a None admin] PATH_INFO: `/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.100475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7d5c2-e7c3-46a5-9e2e-bb3053636a8a None admin] RBAC: Authorizing `identity:get_group(group_id=28d5e0e97adc44a4ac06ba6d04cc383f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:03.101909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed7d5c2-e7c3-46a5-9e2e-bb3053636a8a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:03.102132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1156759-8b73-47b9-abf1-102c703ec00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.103003 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156759-8b73-47b9-abf1-102c703ec00d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.103290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156759-8b73-47b9-abf1-102c703ec00d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.103569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156759-8b73-47b9-abf1-102c703ec00d None admin] PATH_INFO: `/v3/groups/7015d69d81dd4aeda890bded697a8290` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.103842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 239/452] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/groups/28d5e0e97adc44a4ac06ba6d04cc383f => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:03.104968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1156759-8b73-47b9-abf1-102c703ec00d None admin] RBAC: Authorizing `identity:get_group(group_id=7015d69d81dd4aeda890bded697a8290)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:03.106453 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1156759-8b73-47b9-abf1-102c703ec00d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:03.108195 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 214/453] 10.222.0.79 () {56 vars in 1180 bytes} [Wed May 25 14:29:02 2022] GET /identity/v3/groups/7015d69d81dd4aeda890bded697a8290 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:03.114034 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7d5c2-e7c3-46a5-9e2e-bb3053636a8a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:03.114202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1156759-8b73-47b9-abf1-102c703ec00d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:03.118767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:03.194463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:03.215680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed7d5c2-e7c3-46a5-9e2e-bb3053636a8a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.218591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1156759-8b73-47b9-abf1-102c703ec00d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:03.248818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b27ff-27af-42ca-9933-70dff429b31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.249465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b27ff-27af-42ca-9933-70dff429b31f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.249791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b27ff-27af-42ca-9933-70dff429b31f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.250029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b27ff-27af-42ca-9933-70dff429b31f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.250885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b27ff-27af-42ca-9933-70dff429b31f None admin] RBAC: Adding query filter params (group.id=28d5e0e97adc44a4ac06ba6d04cc383f, role.id=5cb95ca9624d408a80d77ecc45d0c310, scope.project.id=19b8d221fd644566a8af166462a8a3db) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:03.251208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b27ff-27af-42ca-9933-70dff429b31f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:03.252644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b27ff-27af-42ca-9933-70dff429b31f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:03.252748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141ff88-8950-4919-b7f7-dce65aa9cc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:03.253345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141ff88-8950-4919-b7f7-dce65aa9cc9a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:03.253630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141ff88-8950-4919-b7f7-dce65aa9cc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:03.253909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141ff88-8950-4919-b7f7-dce65aa9cc9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:03.254774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141ff88-8950-4919-b7f7-dce65aa9cc9a None admin] RBAC: Adding query filter params (group.id=7015d69d81dd4aeda890bded697a8290, role.id=308d9785120a49079e02659953a2b033, scope.project.id=d9c7281911bf46ffacaa598981eac3c1) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:03.255085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141ff88-8950-4919-b7f7-dce65aa9cc9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:03.256526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141ff88-8950-4919-b7f7-dce65aa9cc9a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:03.258546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 240/454] 10.222.0.79 () {56 vars in 1376 bytes} [Wed May 25 14:29:03 2022] GET /identity/v3/role_assignments?group.id=28d5e0e97adc44a4ac06ba6d04cc383f&scope.project.id=19b8d221fd644566a8af166462a8a3db&role.id=5cb95ca9624d408a80d77ecc45d0c310 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:03.262804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 215/455] 10.222.0.79 () {56 vars in 1376 bytes} [Wed May 25 14:29:03 2022] GET /identity/v3/role_assignments?group.id=7015d69d81dd4aeda890bded697a8290&scope.project.id=d9c7281911bf46ffacaa598981eac3c1&role.id=308d9785120a49079e02659953a2b033 => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:05.999137 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91a03f-05cc-45ae-91aa-eaf369982a72 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:05.999674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91a03f-05cc-45ae-91aa-eaf369982a72 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:05.999674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f91a03f-05cc-45ae-91aa-eaf369982a72 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.001363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 241/456] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:06.006882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209111f-7156-42ea-aaea-afa1f382aa75 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.007299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209111f-7156-42ea-aaea-afa1f382aa75 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.007460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209111f-7156-42ea-aaea-afa1f382aa75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.031067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d209111f-7156-42ea-aaea-afa1f382aa75 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:06.032277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d209111f-7156-42ea-aaea-afa1f382aa75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:06.118235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.130219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 216/457] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:06.170331 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91a03f-05cc-45ae-91aa-eaf369982a72 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.312847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f91a03f-05cc-45ae-91aa-eaf369982a72 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.339525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a72e5-9caf-4ce8-bf0b-c76f2cf0185f None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.340177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a72e5-9caf-4ce8-bf0b-c76f2cf0185f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.340685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a72e5-9caf-4ce8-bf0b-c76f2cf0185f None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.346104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 217/458] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:06.347995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a4f9-3e80-4e6b-b2f2-8d115bd1acdb None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.348526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a4f9-3e80-4e6b-b2f2-8d115bd1acdb None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.349009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888a4f9-3e80-4e6b-b2f2-8d115bd1acdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.369387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1daef1-22d5-499a-9b59-106d0796f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.369593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e888a4f9-3e80-4e6b-b2f2-8d115bd1acdb None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:06.370547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e888a4f9-3e80-4e6b-b2f2-8d115bd1acdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:06.370906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1daef1-22d5-499a-9b59-106d0796f523 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.371391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1daef1-22d5-499a-9b59-106d0796f523 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.371876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1daef1-22d5-499a-9b59-106d0796f523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.396814 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1daef1-22d5-499a-9b59-106d0796f523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.399312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1daef1-22d5-499a-9b59-106d0796f523 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.403627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2e1daef1-22d5-499a-9b59-106d0796f523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:06.431684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:06.432617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:06.433913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:06.433913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:06.433913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:06.433913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:06.433913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 242/459] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:06.451562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1daef1-22d5-499a-9b59-106d0796f523 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.521683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 218/460] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:06.523090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cea94-26c8-4254-a3e2-7a391be7ebe7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.523384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cea94-26c8-4254-a3e2-7a391be7ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.523661 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cea94-26c8-4254-a3e2-7a391be7ebe7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.529205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 219/461] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:06.530383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bfc67-63ab-4e29-9d1f-7b876df9de38 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.530679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bfc67-63ab-4e29-9d1f-7b876df9de38 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.530962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bfc67-63ab-4e29-9d1f-7b876df9de38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.556632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a24bfc67-63ab-4e29-9d1f-7b876df9de38 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:06.557838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a24bfc67-63ab-4e29-9d1f-7b876df9de38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:06.587688 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1daef1-22d5-499a-9b59-106d0796f523 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.629670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90501fd-b1d3-4b02-8712-54af38a95ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.630281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90501fd-b1d3-4b02-8712-54af38a95ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.630407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 220/462] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:06.630566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90501fd-b1d3-4b02-8712-54af38a95ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.630833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90501fd-b1d3-4b02-8712-54af38a95ec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.631207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bfc67-63ab-4e29-9d1f-7b876df9de38 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.631545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90501fd-b1d3-4b02-8712-54af38a95ec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:06.631848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90501fd-b1d3-4b02-8712-54af38a95ec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.633225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90501fd-b1d3-4b02-8712-54af38a95ec1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.647661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 243/463] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:06.655424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90501fd-b1d3-4b02-8712-54af38a95ec1 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.704726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.715561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.754256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bfc67-63ab-4e29-9d1f-7b876df9de38 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.760947 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90501fd-b1d3-4b02-8712-54af38a95ec1 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.791686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6925fcfe-2f89-4d8c-856f-c45e876171c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.792576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925fcfe-2f89-4d8c-856f-c45e876171c1 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.792857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925fcfe-2f89-4d8c-856f-c45e876171c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.793130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6925fcfe-2f89-4d8c-856f-c45e876171c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.795170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f5116-2ec6-4d48-96a7-29ddfc2ec0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:06.795828 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f5116-2ec6-4d48-96a7-29ddfc2ec0b1 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.796110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f5116-2ec6-4d48-96a7-29ddfc2ec0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.796380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f5116-2ec6-4d48-96a7-29ddfc2ec0b1 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.797071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f5116-2ec6-4d48-96a7-29ddfc2ec0b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.798549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f5116-2ec6-4d48-96a7-29ddfc2ec0b1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.804083 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925fcfe-2f89-4d8c-856f-c45e876171c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:06.805929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6925fcfe-2f89-4d8c-856f-c45e876171c1 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:06.826109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 244/464] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:29:06 2022] POST /identity/v3/users => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:29:06.826109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f5116-2ec6-4d48-96a7-29ddfc2ec0b1 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-6925fcfe-2f89-4d8c-856f-c45e876171c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:06.826403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:06.827143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:06.827953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:06.827953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:06.827953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:06.827953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:06.827953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 221/465] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:06.827953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd7eb-6ce2-4b47-b398-d110b3f1eea0 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:06.827953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd7eb-6ce2-4b47-b398-d110b3f1eea0 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:06.828325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ddd7eb-6ce2-4b47-b398-d110b3f1eea0 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:06.834151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 222/466] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:06.834151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd7eb-6ce2-4b47-b398-d110b3f1eea0 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:06.956170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ddd7eb-6ce2-4b47-b398-d110b3f1eea0 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.969637 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:06.983853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f5116-2ec6-4d48-96a7-29ddfc2ec0b1 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:06.998190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:07.005762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672af971-9d16-4f99-af7b-31b5d2c4eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.006700 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af971-9d16-4f99-af7b-31b5d2c4eaec None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.009236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af971-9d16-4f99-af7b-31b5d2c4eaec None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.009236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af971-9d16-4f99-af7b-31b5d2c4eaec None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.009236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672af971-9d16-4f99-af7b-31b5d2c4eaec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:07.009236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672af971-9d16-4f99-af7b-31b5d2c4eaec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.009930 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672af971-9d16-4f99-af7b-31b5d2c4eaec None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.025919 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 223/467] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:07.027109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404bf2-7d06-4e85-8244-9322de98dfbc None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.027394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404bf2-7d06-4e85-8244-9322de98dfbc None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.027667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d404bf2-7d06-4e85-8244-9322de98dfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.039272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11a6ff-44d6-4185-b559-998bdb3a9d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.040502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11a6ff-44d6-4185-b559-998bdb3a9d19 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.040792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11a6ff-44d6-4185-b559-998bdb3a9d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.041068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11a6ff-44d6-4185-b559-998bdb3a9d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.045366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-3d404bf2-7d06-4e85-8244-9322de98dfbc None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:07.047383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3d404bf2-7d06-4e85-8244-9322de98dfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:07.054803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11a6ff-44d6-4185-b559-998bdb3a9d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.056898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11a6ff-44d6-4185-b559-998bdb3a9d19 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-7e11a6ff-44d6-4185-b559-998bdb3a9d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:07.083347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:07.084243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:07.085051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:07.085051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:07.085051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:07.085051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:07.085051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 245/468] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:07.085051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11a6ff-44d6-4185-b559-998bdb3a9d19 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.142004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 224/469] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:07.143276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404bf2-7d06-4e85-8244-9322de98dfbc None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.202859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11a6ff-44d6-4185-b559-998bdb3a9d19 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.240493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdcf0a-8b21-4d6b-80a3-2cc9fc34df3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.241070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdcf0a-8b21-4d6b-80a3-2cc9fc34df3e None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.241352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdcf0a-8b21-4d6b-80a3-2cc9fc34df3e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.241622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbdcf0a-8b21-4d6b-80a3-2cc9fc34df3e None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.242366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdcf0a-8b21-4d6b-80a3-2cc9fc34df3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.243805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbdcf0a-8b21-4d6b-80a3-2cc9fc34df3e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.268744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 246/470] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:29:07 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:07.269819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdcf0a-8b21-4d6b-80a3-2cc9fc34df3e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.276307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:07.280206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d404bf2-7d06-4e85-8244-9322de98dfbc None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.297639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:07.327189 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f325e-df03-4834-baad-2f215a8bd55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.328351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f325e-df03-4834-baad-2f215a8bd55d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.328937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f325e-df03-4834-baad-2f215a8bd55d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.329418 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f325e-df03-4834-baad-2f215a8bd55d None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.330490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f325e-df03-4834-baad-2f215a8bd55d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:07.331026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f325e-df03-4834-baad-2f215a8bd55d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.333152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26f325e-df03-4834-baad-2f215a8bd55d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.347235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 225/471] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:07.353167 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f325e-df03-4834-baad-2f215a8bd55d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.412296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbdcf0a-8b21-4d6b-80a3-2cc9fc34df3e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.462746 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b16565-5f13-49d8-ad67-d7592a7340d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.463685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16565-5f13-49d8-ad67-d7592a7340d2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.463978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16565-5f13-49d8-ad67-d7592a7340d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.464254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b16565-5f13-49d8-ad67-d7592a7340d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.473738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26f325e-df03-4834-baad-2f215a8bd55d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.480871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b16565-5f13-49d8-ad67-d7592a7340d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.482650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b16565-5f13-49d8-ad67-d7592a7340d2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-05b16565-5f13-49d8-ad67-d7592a7340d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:07.503719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:07.504581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:07.505379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:07.505379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:07.505379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:07.505379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:07.505379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 247/472] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:07.510538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b16565-5f13-49d8-ad67-d7592a7340d2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.519351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1dff54-34b4-4d10-ba44-8289d460a8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.520375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dff54-34b4-4d10-ba44-8289d460a8e3 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.521352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dff54-34b4-4d10-ba44-8289d460a8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.521813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1dff54-34b4-4d10-ba44-8289d460a8e3 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.522785 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dff54-34b4-4d10-ba44-8289d460a8e3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.525321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1dff54-34b4-4d10-ba44-8289d460a8e3 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.553903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 226/473] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:29:07 2022] POST /identity/v3/users => generated 248 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:29:07.625476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:07.653358 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019c9f9-7510-4779-bc01-29ab60937f22 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.653646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019c9f9-7510-4779-bc01-29ab60937f22 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.653927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019c9f9-7510-4779-bc01-29ab60937f22 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.656895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 227/474] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:29:07.664102 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac979987-297d-429c-ab0a-7cf25904a3fc None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.664442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac979987-297d-429c-ab0a-7cf25904a3fc None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.664671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac979987-297d-429c-ab0a-7cf25904a3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.665706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b16565-5f13-49d8-ad67-d7592a7340d2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.684079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-ac979987-297d-429c-ab0a-7cf25904a3fc None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:07.685404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ac979987-297d-429c-ab0a-7cf25904a3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:07.699290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:07.715992 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4ab1d-ef16-4edb-9c31-bda5723d4344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.716718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4ab1d-ef16-4edb-9c31-bda5723d4344 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.717278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4ab1d-ef16-4edb-9c31-bda5723d4344 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.717602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce4ab1d-ef16-4edb-9c31-bda5723d4344 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.721384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4ab1d-ef16-4edb-9c31-bda5723d4344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:07.721384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4ab1d-ef16-4edb-9c31-bda5723d4344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.721384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce4ab1d-ef16-4edb-9c31-bda5723d4344 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.733769 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 248/475] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:07.739224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4ab1d-ef16-4edb-9c31-bda5723d4344 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.777370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 228/476] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:07.800245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac979987-297d-429c-ab0a-7cf25904a3fc None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:07.861259 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce4ab1d-ef16-4edb-9c31-bda5723d4344 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.902789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:07.908455 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf225599-da81-4e6c-8d08-9bfc440ebccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:07.910564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf225599-da81-4e6c-8d08-9bfc440ebccd None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:07.911680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf225599-da81-4e6c-8d08-9bfc440ebccd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:07.912124 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf225599-da81-4e6c-8d08-9bfc440ebccd None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:07.913241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf225599-da81-4e6c-8d08-9bfc440ebccd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:07.915467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf225599-da81-4e6c-8d08-9bfc440ebccd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:07.945249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac979987-297d-429c-ab0a-7cf25904a3fc None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:07.950107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 249/477] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:29:07 2022] POST /identity/v3/users => generated 249 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:08.002848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c5df-6c0e-4f7d-ad13-8964c960ecb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:08.003633 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c5df-6c0e-4f7d-ad13-8964c960ecb0 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:08.003925 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c5df-6c0e-4f7d-ad13-8964c960ecb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:08.004203 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46c5df-6c0e-4f7d-ad13-8964c960ecb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:08.005022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46c5df-6c0e-4f7d-ad13-8964c960ecb0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:08.006543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46c5df-6c0e-4f7d-ad13-8964c960ecb0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:08.016502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.sql.core [None req-1d46c5df-6c0e-4f7d-ad13-8964c960ecb0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:29:08.016502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 14:29:08.016502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [parameters: {'id': 'c6f8992e1b7944c69ecd50c1e6bcfb03', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 14:29:08.016502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80476) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-1d46c5df-6c0e-4f7d-ad13-8964c960ecb0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application conn.query(q) May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result.read() May 25 14:29:08.035837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return ref.to_dict() May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:29:08.036731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application next(self.gen) May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application yield resource May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application next(self.gen) May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise self.value May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application session.commit() May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:29:08.037618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.session.flush() May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application compat.raise_( May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:29:08.039104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:29:08.039936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application conn.query(q) May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result.read() May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:29:08.040750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [parameters: {'id': 'c6f8992e1b7944c69ecd50c1e6bcfb03', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:08.041527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 14:29:08.042437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:08.043248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 229/478] 10.222.0.79 () {60 vars in 1131 bytes} [Wed May 25 14:29:07 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:08.043310 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf225599-da81-4e6c-8d08-9bfc440ebccd None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:08.164002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf225599-da81-4e6c-8d08-9bfc440ebccd None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:08.207450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865010c-575b-4375-90d7-1ec3e48b6063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:08.208274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865010c-575b-4375-90d7-1ec3e48b6063 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:08.208559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865010c-575b-4375-90d7-1ec3e48b6063 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:08.208829 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865010c-575b-4375-90d7-1ec3e48b6063 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:08.223071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865010c-575b-4375-90d7-1ec3e48b6063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-1865010c-575b-4375-90d7-1ec3e48b6063 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:08.231549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:08.233619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:08.235613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 250/479] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:08.239096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c5df-6c0e-4f7d-ad13-8964c960ecb0 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:08.263189 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:08.363075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46c5df-6c0e-4f7d-ad13-8964c960ecb0 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:08.398330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4263e-fab4-4a7a-aa05-9558147a259f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:08.399004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4263e-fab4-4a7a-aa05-9558147a259f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:08.399288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4263e-fab4-4a7a-aa05-9558147a259f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:08.399567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4263e-fab4-4a7a-aa05-9558147a259f None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:08.400331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4263e-fab4-4a7a-aa05-9558147a259f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:08.400638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4263e-fab4-4a7a-aa05-9558147a259f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:08.402021 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca4263e-fab4-4a7a-aa05-9558147a259f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:08.411488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 230/480] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:09.584510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362367b-802f-4493-98a2-111a33de18f4 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:09.585199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362367b-802f-4493-98a2-111a33de18f4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:09.585199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362367b-802f-4493-98a2-111a33de18f4 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:09.586715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 251/481] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:09.591780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eebd2-fc89-4fc0-97d2-e1e41110b98c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:09.592287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eebd2-fc89-4fc0-97d2-e1e41110b98c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:09.592455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242eebd2-fc89-4fc0-97d2-e1e41110b98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:09.615058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-242eebd2-fc89-4fc0-97d2-e1e41110b98c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:09.616252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-242eebd2-fc89-4fc0-97d2-e1e41110b98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:09.719768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 231/482] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:09.760102 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362367b-802f-4493-98a2-111a33de18f4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:09.818996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:09.911771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362367b-802f-4493-98a2-111a33de18f4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:09.961632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52365b59-74f6-4ed4-ac97-e5734dd158af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:09.962465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365b59-74f6-4ed4-ac97-e5734dd158af None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:09.962745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365b59-74f6-4ed4-ac97-e5734dd158af None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:09.963016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52365b59-74f6-4ed4-ac97-e5734dd158af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:09.979045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52365b59-74f6-4ed4-ac97-e5734dd158af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-52365b59-74f6-4ed4-ac97-e5734dd158af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:09.986893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:09.989008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:09.991023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 252/483] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:09.999728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242eebd2-fc89-4fc0-97d2-e1e41110b98c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:10.001922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:10.127079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1aa6d-7103-4a9b-8b6e-259ce888cbc6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.127371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1aa6d-7103-4a9b-8b6e-259ce888cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.127536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea1aa6d-7103-4a9b-8b6e-259ce888cbc6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.129408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 253/484] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:10.134566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d4aa-904f-4f2c-9782-42a5a8994ecf None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.134855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d4aa-904f-4f2c-9782-42a5a8994ecf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.135133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23d4aa-904f-4f2c-9782-42a5a8994ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.137662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242eebd2-fc89-4fc0-97d2-e1e41110b98c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:10.168132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9d23d4aa-904f-4f2c-9782-42a5a8994ecf None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:10.169334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9d23d4aa-904f-4f2c-9782-42a5a8994ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:10.181177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64d9a2-a0e6-43e8-a066-96ac09d0cd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:10.181847 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64d9a2-a0e6-43e8-a066-96ac09d0cd3e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.182158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64d9a2-a0e6-43e8-a066-96ac09d0cd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.182435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64d9a2-a0e6-43e8-a066-96ac09d0cd3e None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.183189 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64d9a2-a0e6-43e8-a066-96ac09d0cd3e None admin] RBAC: Adding query filter params (name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:10.183491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64d9a2-a0e6-43e8-a066-96ac09d0cd3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:10.184866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64d9a2-a0e6-43e8-a066-96ac09d0cd3e None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:10.199498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 232/485] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:10.204480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64d9a2-a0e6-43e8-a066-96ac09d0cd3e None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:10.314905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 254/486] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:10.330581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:10.339137 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23d4aa-904f-4f2c-9782-42a5a8994ecf None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:10.370335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64d9a2-a0e6-43e8-a066-96ac09d0cd3e None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:10.404771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:10.437499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e048ab-3ae1-4bcb-a5c3-1ab08b4d641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:10.438440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e048ab-3ae1-4bcb-a5c3-1ab08b4d641f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.438724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e048ab-3ae1-4bcb-a5c3-1ab08b4d641f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.438998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e048ab-3ae1-4bcb-a5c3-1ab08b4d641f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.452995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e048ab-3ae1-4bcb-a5c3-1ab08b4d641f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:10.454517 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e048ab-3ae1-4bcb-a5c3-1ab08b4d641f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-e1e048ab-3ae1-4bcb-a5c3-1ab08b4d641f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:10.472600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:10.473490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:10.474673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:10.474673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:10.474673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:10.474673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:10.474673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 233/487] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:10.480627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e048ab-3ae1-4bcb-a5c3-1ab08b4d641f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:10.535052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23d4aa-904f-4f2c-9782-42a5a8994ecf None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:10.572991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0de1c65-8a3a-4504-8629-ed74df6b9b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:10.574356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1c65-8a3a-4504-8629-ed74df6b9b14 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.574893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1c65-8a3a-4504-8629-ed74df6b9b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.575384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0de1c65-8a3a-4504-8629-ed74df6b9b14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.586721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0de1c65-8a3a-4504-8629-ed74df6b9b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-d0de1c65-8a3a-4504-8629-ed74df6b9b14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:10.600148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:10.601189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:10.601967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:10.606025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e048ab-3ae1-4bcb-a5c3-1ab08b4d641f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:10.607878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 255/488] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:10.610812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0969-a5b2-41b3-bf3d-b85b923f1bca None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.611826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0969-a5b2-41b3-bf3d-b85b923f1bca None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.613209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6e0969-a5b2-41b3-bf3d-b85b923f1bca None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.620253 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 256/489] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:10.622264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e0969-a5b2-41b3-bf3d-b85b923f1bca None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:10.625299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:10.645575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8c10a8-fed3-4d89-aa1e-546b2e635450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:10.646305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c10a8-fed3-4d89-aa1e-546b2e635450 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.646599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c10a8-fed3-4d89-aa1e-546b2e635450 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.646891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8c10a8-fed3-4d89-aa1e-546b2e635450 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.647611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c10a8-fed3-4d89-aa1e-546b2e635450 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:10.647918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c10a8-fed3-4d89-aa1e-546b2e635450 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:10.649477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8c10a8-fed3-4d89-aa1e-546b2e635450 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:10.664510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 234/490] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:10.665863 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda28ddf-2bc8-471b-8833-41cafa508cce None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.666196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda28ddf-2bc8-471b-8833-41cafa508cce None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.666475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda28ddf-2bc8-471b-8833-41cafa508cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.685476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-eda28ddf-2bc8-471b-8833-41cafa508cce None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:10.686854 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-eda28ddf-2bc8-471b-8833-41cafa508cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:10.741653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:10.751019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6e0969-a5b2-41b3-bf3d-b85b923f1bca None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:10.770343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 235/491] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:10.771431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda28ddf-2bc8-471b-8833-41cafa508cce None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:10.789148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc077fce-a4ae-4d15-8b8e-7417cb2d3736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:10.790222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc077fce-a4ae-4d15-8b8e-7417cb2d3736 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.790710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc077fce-a4ae-4d15-8b8e-7417cb2d3736 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.791188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc077fce-a4ae-4d15-8b8e-7417cb2d3736 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.792237 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc077fce-a4ae-4d15-8b8e-7417cb2d3736 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:10.792900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc077fce-a4ae-4d15-8b8e-7417cb2d3736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:10.794591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc077fce-a4ae-4d15-8b8e-7417cb2d3736 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:10.804598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 257/492] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:10.809185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc077fce-a4ae-4d15-8b8e-7417cb2d3736 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:10.902332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda28ddf-2bc8-471b-8833-41cafa508cce None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:10.911598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:10.916196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc077fce-a4ae-4d15-8b8e-7417cb2d3736 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:10.939707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b611a8-20be-4fe2-bf8c-8dfc602ce293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:10.940500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b611a8-20be-4fe2-bf8c-8dfc602ce293 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.940805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b611a8-20be-4fe2-bf8c-8dfc602ce293 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.941080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b611a8-20be-4fe2-bf8c-8dfc602ce293 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.948344 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b611a8-20be-4fe2-bf8c-8dfc602ce293 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:10.949799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b611a8-20be-4fe2-bf8c-8dfc602ce293 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:10.957739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987a101-394c-4674-a38a-fddd101772c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:10.958562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987a101-394c-4674-a38a-fddd101772c2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.958845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987a101-394c-4674-a38a-fddd101772c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.959119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987a101-394c-4674-a38a-fddd101772c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-e7b611a8-20be-4fe2-bf8c-8dfc602ce293 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:10.966001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:10.967114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 236/493] 10.222.0.79 () {56 vars in 1093 bytes} [Wed May 25 14:29:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:10.968002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b611a8-20be-4fe2-bf8c-8dfc602ce293 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:10.975778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0987a101-394c-4674-a38a-fddd101772c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0987a101-394c-4674-a38a-fddd101772c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:10.983663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:10.984535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:10.986120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 258/494] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:10.991303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc825d1-0c8c-4bb5-b6c8-3d5113584b50 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:10.991595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc825d1-0c8c-4bb5-b6c8-3d5113584b50 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:10.991876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc825d1-0c8c-4bb5-b6c8-3d5113584b50 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:10.993401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 259/495] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:10.993860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc825d1-0c8c-4bb5-b6c8-3d5113584b50 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:11.015133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:11.080869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b611a8-20be-4fe2-bf8c-8dfc602ce293 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:11.104474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc825d1-0c8c-4bb5-b6c8-3d5113584b50 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:11.116814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173be1c-1e20-4596-940e-20eabdbdbb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:11.117612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173be1c-1e20-4596-940e-20eabdbdbb7b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.117892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173be1c-1e20-4596-940e-20eabdbdbb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.118208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0173be1c-1e20-4596-940e-20eabdbdbb7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.128924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173be1c-1e20-4596-940e-20eabdbdbb7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:11.130419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0173be1c-1e20-4596-940e-20eabdbdbb7b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:11.142161 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec382e6-8af3-4454-9f47-bf1156d2b7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:11.142882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec382e6-8af3-4454-9f47-bf1156d2b7bf None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.143169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec382e6-8af3-4454-9f47-bf1156d2b7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.143445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec382e6-8af3-4454-9f47-bf1156d2b7bf None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.144848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec382e6-8af3-4454-9f47-bf1156d2b7bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:11.145159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec382e6-8af3-4454-9f47-bf1156d2b7bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:11.146637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec382e6-8af3-4454-9f47-bf1156d2b7bf None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-0173be1c-1e20-4596-940e-20eabdbdbb7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:11.148655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:11.149515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:11.150384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:11.150384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:11.150384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:11.150384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:11.154418 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 237/496] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:11.154990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173be1c-1e20-4596-940e-20eabdbdbb7b None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:11.174199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:11.193345 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 260/497] 10.222.0.79 () {56 vars in 1133 bytes} [Wed May 25 14:29:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:11.194737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843a84-cf34-44d9-ba3d-5632ff601a11 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.195033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843a84-cf34-44d9-ba3d-5632ff601a11 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.195313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b843a84-cf34-44d9-ba3d-5632ff601a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.211808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7b843a84-cf34-44d9-ba3d-5632ff601a11 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:11.212981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7b843a84-cf34-44d9-ba3d-5632ff601a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:11.258259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0173be1c-1e20-4596-940e-20eabdbdbb7b None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:11.284077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 261/498] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:11.285758 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b843a84-cf34-44d9-ba3d-5632ff601a11 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:11.293902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:11.303774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915167d7-0fec-49a3-a612-c108559c61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:11.304750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915167d7-0fec-49a3-a612-c108559c61a1 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.304872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915167d7-0fec-49a3-a612-c108559c61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.305164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915167d7-0fec-49a3-a612-c108559c61a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.306367 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915167d7-0fec-49a3-a612-c108559c61a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:11.306688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915167d7-0fec-49a3-a612-c108559c61a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:11.308196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915167d7-0fec-49a3-a612-c108559c61a1 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:11.317599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 238/499] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:11.318604 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915167d7-0fec-49a3-a612-c108559c61a1 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:11.398196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b843a84-cf34-44d9-ba3d-5632ff601a11 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:11.406290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:11.429777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915167d7-0fec-49a3-a612-c108559c61a1 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:11.436097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5aa8d-b0c5-4345-9fcb-e10c3ffd9fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:11.436765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5aa8d-b0c5-4345-9fcb-e10c3ffd9fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.437044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5aa8d-b0c5-4345-9fcb-e10c3ffd9fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.437322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a5aa8d-b0c5-4345-9fcb-e10c3ffd9fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.438038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5aa8d-b0c5-4345-9fcb-e10c3ffd9fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:11.438371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5aa8d-b0c5-4345-9fcb-e10c3ffd9fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:11.439755 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a5aa8d-b0c5-4345-9fcb-e10c3ffd9fe8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:11.451453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 262/500] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:11.451453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5aa8d-b0c5-4345-9fcb-e10c3ffd9fe8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:11.467258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e07af2-ec50-4cc9-aff0-2e92dd022b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:11.467961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e07af2-ec50-4cc9-aff0-2e92dd022b0f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.468247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e07af2-ec50-4cc9-aff0-2e92dd022b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.468528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e07af2-ec50-4cc9-aff0-2e92dd022b0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.515774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:11.539847 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e07af2-ec50-4cc9-aff0-2e92dd022b0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:11.541292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e07af2-ec50-4cc9-aff0-2e92dd022b0f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:11.549409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a5aa8d-b0c5-4345-9fcb-e10c3ffd9fe8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:11.582759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934cb44-4679-4954-af90-30f5f22eea4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:11.583541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934cb44-4679-4954-af90-30f5f22eea4a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.583824 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934cb44-4679-4954-af90-30f5f22eea4a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.584104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934cb44-4679-4954-af90-30f5f22eea4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.594010 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934cb44-4679-4954-af90-30f5f22eea4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-8934cb44-4679-4954-af90-30f5f22eea4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:11.601803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:11.602799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:11.603553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 263/501] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:11.604189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934cb44-4679-4954-af90-30f5f22eea4a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:11.622154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:11.642412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 239/502] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:11.643774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a003f-f253-4e76-b6ba-f9cc180e12ab None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.644550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a003f-f253-4e76-b6ba-f9cc180e12ab None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.644829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412a003f-f253-4e76-b6ba-f9cc180e12ab None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.646100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 240/503] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:11.646794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a003f-f253-4e76-b6ba-f9cc180e12ab None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:11.706320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934cb44-4679-4954-af90-30f5f22eea4a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:11.731016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:11.739505 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55f80f-ac02-4dae-8db9-aa2d355747fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:11.740288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55f80f-ac02-4dae-8db9-aa2d355747fe None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.740570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55f80f-ac02-4dae-8db9-aa2d355747fe None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.740843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55f80f-ac02-4dae-8db9-aa2d355747fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.748305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412a003f-f253-4e76-b6ba-f9cc180e12ab None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:11.751049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55f80f-ac02-4dae-8db9-aa2d355747fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:11.752505 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55f80f-ac02-4dae-8db9-aa2d355747fe None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-eb55f80f-ac02-4dae-8db9-aa2d355747fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:11.770412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:11.771266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:11.772105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:11.772105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:11.772105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:11.772105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:11.772105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 264/504] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:11.772373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55f80f-ac02-4dae-8db9-aa2d355747fe None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:11.786456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5e624-73fd-493a-bdd5-4fc616fe4e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:11.787251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5e624-73fd-493a-bdd5-4fc616fe4e69 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.787530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5e624-73fd-493a-bdd5-4fc616fe4e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.787805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5e624-73fd-493a-bdd5-4fc616fe4e69 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.794695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5e624-73fd-493a-bdd5-4fc616fe4e69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:11.796128 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5e624-73fd-493a-bdd5-4fc616fe4e69 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-a8e5e624-73fd-493a-bdd5-4fc616fe4e69 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:11.810911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:11.811773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:11.812646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 241/505] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:11.813497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5e624-73fd-493a-bdd5-4fc616fe4e69 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:11.857597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:11.873321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55f80f-ac02-4dae-8db9-aa2d355747fe None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:11.907329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021b63f3-a139-46c7-8755-ff1a3d6e1d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:11.907987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b63f3-a139-46c7-8755-ff1a3d6e1d7e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.908273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b63f3-a139-46c7-8755-ff1a3d6e1d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.908552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b63f3-a139-46c7-8755-ff1a3d6e1d7e None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.909300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b63f3-a139-46c7-8755-ff1a3d6e1d7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:11.909609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b63f3-a139-46c7-8755-ff1a3d6e1d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:11.911031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021b63f3-a139-46c7-8755-ff1a3d6e1d7e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:11.914980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5e624-73fd-493a-bdd5-4fc616fe4e69 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:11.918830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 265/506] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:11.920065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819492c-8db6-4f0e-b7ca-bfd003e31731 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.920361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819492c-8db6-4f0e-b7ca-bfd003e31731 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.920638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819492c-8db6-4f0e-b7ca-bfd003e31731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.937009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7819492c-8db6-4f0e-b7ca-bfd003e31731 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:11.938213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7819492c-8db6-4f0e-b7ca-bfd003e31731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:11.949922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34cfb1-b916-42fd-bd75-d69eff2db27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:11.950736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34cfb1-b916-42fd-bd75-d69eff2db27c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:11.951014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34cfb1-b916-42fd-bd75-d69eff2db27c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:11.951282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34cfb1-b916-42fd-bd75-d69eff2db27c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:11.960965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34cfb1-b916-42fd-bd75-d69eff2db27c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:11.962371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34cfb1-b916-42fd-bd75-d69eff2db27c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:11.971778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-fd34cfb1-b916-42fd-bd75-d69eff2db27c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:11.980226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:11.981072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:11.981893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:11.981893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:11.981893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:11.981893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:11.981893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 242/507] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:11.982584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34cfb1-b916-42fd-bd75-d69eff2db27c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.005206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 266/508] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:12.005952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819492c-8db6-4f0e-b7ca-bfd003e31731 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.077464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.087225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34cfb1-b916-42fd-bd75-d69eff2db27c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.102021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819492c-8db6-4f0e-b7ca-bfd003e31731 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.120036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cd606-6508-4c85-8efc-a335505e852d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.120685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd606-6508-4c85-8efc-a335505e852d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.120964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd606-6508-4c85-8efc-a335505e852d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.121257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3cd606-6508-4c85-8efc-a335505e852d None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.121976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cd606-6508-4c85-8efc-a335505e852d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:12.122333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cd606-6508-4c85-8efc-a335505e852d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.123704 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3cd606-6508-4c85-8efc-a335505e852d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.135080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 243/509] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:12.135718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bdb3f-228a-4a43-93f3-00f4f5024b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.136109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cd606-6508-4c85-8efc-a335505e852d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.136457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bdb3f-228a-4a43-93f3-00f4f5024b39 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.136805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bdb3f-228a-4a43-93f3-00f4f5024b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.137025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026bdb3f-228a-4a43-93f3-00f4f5024b39 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.137864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bdb3f-228a-4a43-93f3-00f4f5024b39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:12.138203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bdb3f-228a-4a43-93f3-00f4f5024b39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.139799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026bdb3f-228a-4a43-93f3-00f4f5024b39 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.156783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 267/510] 10.222.0.79 () {56 vars in 1137 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:12.157602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bdb3f-228a-4a43-93f3-00f4f5024b39 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.185516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.234381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3cd606-6508-4c85-8efc-a335505e852d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.255860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026bdb3f-228a-4a43-93f3-00f4f5024b39 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.266899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df594f6-0964-472f-8bf9-f752825d8295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.267694 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df594f6-0964-472f-8bf9-f752825d8295 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.267974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df594f6-0964-472f-8bf9-f752825d8295 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.268245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df594f6-0964-472f-8bf9-f752825d8295 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.278529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df594f6-0964-472f-8bf9-f752825d8295 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.279980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df594f6-0964-472f-8bf9-f752825d8295 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.289333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb178395-5e29-415e-8c7b-db4af640b134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.290012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb178395-5e29-415e-8c7b-db4af640b134 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.290334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb178395-5e29-415e-8c7b-db4af640b134 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.290614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb178395-5e29-415e-8c7b-db4af640b134 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.291325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb178395-5e29-415e-8c7b-db4af640b134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:12.291633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb178395-5e29-415e-8c7b-db4af640b134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.293003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb178395-5e29-415e-8c7b-db4af640b134 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-4df594f6-0964-472f-8bf9-f752825d8295 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:12.297063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:12.298022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:12.304134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:12.304134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:12.304134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:12.304134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:12.304134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 244/511] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:12.304134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df594f6-0964-472f-8bf9-f752825d8295 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.304922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.310407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 268/512] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:12.310407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb178395-5e29-415e-8c7b-db4af640b134 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.394600 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.398882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df594f6-0964-472f-8bf9-f752825d8295 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.406581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb178395-5e29-415e-8c7b-db4af640b134 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.431939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc44b08-cb57-42c5-b1bc-0d1295d69a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.432727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc44b08-cb57-42c5-b1bc-0d1295d69a65 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.433013 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc44b08-cb57-42c5-b1bc-0d1295d69a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.433292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc44b08-cb57-42c5-b1bc-0d1295d69a65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.440367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c02a74-ebe4-40e1-badd-176b4657daa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.441204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c02a74-ebe4-40e1-badd-176b4657daa6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.441533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c02a74-ebe4-40e1-badd-176b4657daa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.442224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c02a74-ebe4-40e1-badd-176b4657daa6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.443707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc44b08-cb57-42c5-b1bc-0d1295d69a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.445161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc44b08-cb57-42c5-b1bc-0d1295d69a65 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.449641 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c02a74-ebe4-40e1-badd-176b4657daa6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.451111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c02a74-ebe4-40e1-badd-176b4657daa6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-ebc44b08-cb57-42c5-b1bc-0d1295d69a65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:12.461819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:12.462673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:12.463494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:12.463494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:12.463494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:12.463494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:12.463494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 245/513] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:12.464011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc44b08-cb57-42c5-b1bc-0d1295d69a65 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-77c02a74-ebe4-40e1-badd-176b4657daa6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:12.466564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:12.467555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:12.468442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 269/514] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:12.468998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c02a74-ebe4-40e1-badd-176b4657daa6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.524270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.568443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc44b08-cb57-42c5-b1bc-0d1295d69a65 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.568594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c02a74-ebe4-40e1-badd-176b4657daa6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.600836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e35682-1e29-495b-966e-7369a355be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.601439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df09f88-b7a8-48a1-8be3-b9181d6add1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.601565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35682-1e29-495b-966e-7369a355be1f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.601650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df09f88-b7a8-48a1-8be3-b9181d6add1c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.601758 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35682-1e29-495b-966e-7369a355be1f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.601869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df09f88-b7a8-48a1-8be3-b9181d6add1c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.602037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e35682-1e29-495b-966e-7369a355be1f None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.602243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df09f88-b7a8-48a1-8be3-b9181d6add1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.602801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e35682-1e29-495b-966e-7369a355be1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:12.603173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e35682-1e29-495b-966e-7369a355be1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.604502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e35682-1e29-495b-966e-7369a355be1f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.616695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 270/515] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:12.617471 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e35682-1e29-495b-966e-7369a355be1f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.627398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.674308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df09f88-b7a8-48a1-8be3-b9181d6add1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.676278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df09f88-b7a8-48a1-8be3-b9181d6add1c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.719233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e35682-1e29-495b-966e-7369a355be1f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.736300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.752656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c422d9-24ee-4e3b-9fa8-31ccedcae8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.753441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c422d9-24ee-4e3b-9fa8-31ccedcae8ee None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.753719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c422d9-24ee-4e3b-9fa8-31ccedcae8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.753988 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c422d9-24ee-4e3b-9fa8-31ccedcae8ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.760690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c422d9-24ee-4e3b-9fa8-31ccedcae8ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.762155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c422d9-24ee-4e3b-9fa8-31ccedcae8ee None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-95c422d9-24ee-4e3b-9fa8-31ccedcae8ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:12.776885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:12.777897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:12.778754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:12.778754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:12.778754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:12.778754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:12.778754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:12.778754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:12.778754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:12.778754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:12.778754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 271/516] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:12.778754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c422d9-24ee-4e3b-9fa8-31ccedcae8ee None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.790937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 246/517] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:12.790937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df09f88-b7a8-48a1-8be3-b9181d6add1c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.842724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:12.877069 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c422d9-24ee-4e3b-9fa8-31ccedcae8ee None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.888870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df09f88-b7a8-48a1-8be3-b9181d6add1c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:12.909932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce2685-5bcf-466d-9c66-1ff493beff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.910627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce2685-5bcf-466d-9c66-1ff493beff29 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.910911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce2685-5bcf-466d-9c66-1ff493beff29 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.911191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce2685-5bcf-466d-9c66-1ff493beff29 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.912027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce2685-5bcf-466d-9c66-1ff493beff29 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:12.912365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce2685-5bcf-466d-9c66-1ff493beff29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.913822 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce2685-5bcf-466d-9c66-1ff493beff29 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.921932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25c213-dd60-4fcd-8ca2-f35bc6ae20d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:12.922610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25c213-dd60-4fcd-8ca2-f35bc6ae20d2 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:12.922888 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25c213-dd60-4fcd-8ca2-f35bc6ae20d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:12.923161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25c213-dd60-4fcd-8ca2-f35bc6ae20d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:12.923873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25c213-dd60-4fcd-8ca2-f35bc6ae20d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:12.924174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25c213-dd60-4fcd-8ca2-f35bc6ae20d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:12.925557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25c213-dd60-4fcd-8ca2-f35bc6ae20d2 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:12.930571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 272/518] 10.222.0.79 () {56 vars in 1137 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:12.931185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce2685-5bcf-466d-9c66-1ff493beff29 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.936833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 247/519] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:12.937642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25c213-dd60-4fcd-8ca2-f35bc6ae20d2 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:12.955375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.030143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce2685-5bcf-466d-9c66-1ff493beff29 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.037774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25c213-dd60-4fcd-8ca2-f35bc6ae20d2 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.056161 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.065296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0528-8e2e-4f9b-9ede-678eaf8370e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.066140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0528-8e2e-4f9b-9ede-678eaf8370e9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.066428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0528-8e2e-4f9b-9ede-678eaf8370e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.066704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0528-8e2e-4f9b-9ede-678eaf8370e9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.070858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35144114-d7bc-46ae-a232-b4b90f3b3a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.071509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35144114-d7bc-46ae-a232-b4b90f3b3a61 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.071798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35144114-d7bc-46ae-a232-b4b90f3b3a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.072078 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35144114-d7bc-46ae-a232-b4b90f3b3a61 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.072865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35144114-d7bc-46ae-a232-b4b90f3b3a61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:13.073181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35144114-d7bc-46ae-a232-b4b90f3b3a61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.074000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0528-8e2e-4f9b-9ede-678eaf8370e9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.074670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35144114-d7bc-46ae-a232-b4b90f3b3a61 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.075471 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0528-8e2e-4f9b-9ede-678eaf8370e9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-9c7b0528-8e2e-4f9b-9ede-678eaf8370e9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:13.089889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:13.090796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:13.091699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 273/520] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:13.092259 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0528-8e2e-4f9b-9ede-678eaf8370e9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:13.092833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 248/521] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:13.093225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35144114-d7bc-46ae-a232-b4b90f3b3a61 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:13.170103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.191599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0528-8e2e-4f9b-9ede-678eaf8370e9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.192660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35144114-d7bc-46ae-a232-b4b90f3b3a61 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.223951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306606d4-7f8f-46f0-884f-75bb6a075426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.224730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306606d4-7f8f-46f0-884f-75bb6a075426 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.225012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306606d4-7f8f-46f0-884f-75bb6a075426 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.225283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306606d4-7f8f-46f0-884f-75bb6a075426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.225485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc651c9f-c6a7-4546-90f3-f40ff29fb304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.226158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc651c9f-c6a7-4546-90f3-f40ff29fb304 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.226441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc651c9f-c6a7-4546-90f3-f40ff29fb304 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.226715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc651c9f-c6a7-4546-90f3-f40ff29fb304 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.235218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306606d4-7f8f-46f0-884f-75bb6a075426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.236767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306606d4-7f8f-46f0-884f-75bb6a075426 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-306606d4-7f8f-46f0-884f-75bb6a075426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:13.254206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:13.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:13.256156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:13.256156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:13.256156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:13.256156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:13.256156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 274/522] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:13.256156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306606d4-7f8f-46f0-884f-75bb6a075426 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:13.295139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc651c9f-c6a7-4546-90f3-f40ff29fb304 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.295541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.296678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc651c9f-c6a7-4546-90f3-f40ff29fb304 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.355213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306606d4-7f8f-46f0-884f-75bb6a075426 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.369956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.388403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161b6c9-1b4a-4030-9849-8e98edb6c8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.389054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161b6c9-1b4a-4030-9849-8e98edb6c8ea None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.389334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161b6c9-1b4a-4030-9849-8e98edb6c8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.389614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161b6c9-1b4a-4030-9849-8e98edb6c8ea None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.390326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161b6c9-1b4a-4030-9849-8e98edb6c8ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.391750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161b6c9-1b4a-4030-9849-8e98edb6c8ea None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.394223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 249/523] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:13.395038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc651c9f-c6a7-4546-90f3-f40ff29fb304 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:13.421107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 275/524] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:29:13 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:13.421107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161b6c9-1b4a-4030-9849-8e98edb6c8ea None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:13.522220 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.526932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc651c9f-c6a7-4546-90f3-f40ff29fb304 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.530681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161b6c9-1b4a-4030-9849-8e98edb6c8ea None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.564570 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2f1ca-c058-419c-a4b6-841fa54073e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.565268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f1ca-c058-419c-a4b6-841fa54073e5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.565589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f1ca-c058-419c-a4b6-841fa54073e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.565862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2f1ca-c058-419c-a4b6-841fa54073e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.566746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2f1ca-c058-419c-a4b6-841fa54073e5 None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=eb66b6f6b5524f3687411fa83d525acc) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:13.567058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2f1ca-c058-419c-a4b6-841fa54073e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.568521 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff2f1ca-c058-419c-a4b6-841fa54073e5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.569879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14fa22-7e9a-4ed1-b367-e070d5c05080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.570606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14fa22-7e9a-4ed1-b367-e070d5c05080 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.570891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14fa22-7e9a-4ed1-b367-e070d5c05080 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.571167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14fa22-7e9a-4ed1-b367-e070d5c05080 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.572025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14fa22-7e9a-4ed1-b367-e070d5c05080 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:13.572337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14fa22-7e9a-4ed1-b367-e070d5c05080 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.573804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14fa22-7e9a-4ed1-b367-e070d5c05080 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.586736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 250/525] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:13 2022] GET /identity/v3/role_assignments?user.id=eb66b6f6b5524f3687411fa83d525acc&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:13.586736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2f1ca-c058-419c-a4b6-841fa54073e5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:13.607397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 276/526] 10.222.0.79 () {56 vars in 1139 bytes} [Wed May 25 14:29:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:13.608426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14fa22-7e9a-4ed1-b367-e070d5c05080 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:13.639957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.721415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2f1ca-c058-419c-a4b6-841fa54073e5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.738704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14fa22-7e9a-4ed1-b367-e070d5c05080 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.766488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b05ea-482e-4db3-8a23-861de3ef8f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.767531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b05ea-482e-4db3-8a23-861de3ef8f98 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.767822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b05ea-482e-4db3-8a23-861de3ef8f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.768098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b05ea-482e-4db3-8a23-861de3ef8f98 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.769699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b05ea-482e-4db3-8a23-861de3ef8f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:13.770011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b05ea-482e-4db3-8a23-861de3ef8f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.772584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b05ea-482e-4db3-8a23-861de3ef8f98 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.783425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f8c0f-3b9a-4c49-94d5-3e01fc06bee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.784292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f8c0f-3b9a-4c49-94d5-3e01fc06bee1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.784579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f8c0f-3b9a-4c49-94d5-3e01fc06bee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.784854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f8c0f-3b9a-4c49-94d5-3e01fc06bee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.787610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 251/527] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:13.788999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b05ea-482e-4db3-8a23-861de3ef8f98 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:13.796443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f8c0f-3b9a-4c49-94d5-3e01fc06bee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.798286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f8c0f-3b9a-4c49-94d5-3e01fc06bee1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-098f8c0f-3b9a-4c49-94d5-3e01fc06bee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:13.818832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:13.819727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:13.820733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:13.820733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:13.820733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:13.820733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:13.820733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 277/528] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:13.826060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f8c0f-3b9a-4c49-94d5-3e01fc06bee1 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:13.830814 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.930023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b05ea-482e-4db3-8a23-861de3ef8f98 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.947149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:13.947763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f8c0f-3b9a-4c49-94d5-3e01fc06bee1 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:13.979277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bb4b8-5327-43f6-afcb-e29885f5f59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.980898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bb4b8-5327-43f6-afcb-e29885f5f59f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.981649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bb4b8-5327-43f6-afcb-e29885f5f59f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.982208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bb4b8-5327-43f6-afcb-e29885f5f59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.985637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907ba82-a5c1-420c-9eec-428659a5c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:13.986919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907ba82-a5c1-420c-9eec-428659a5c349 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:13.986919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907ba82-a5c1-420c-9eec-428659a5c349 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:13.987210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e907ba82-a5c1-420c-9eec-428659a5c349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:13.997190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907ba82-a5c1-420c-9eec-428659a5c349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:13.998679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e907ba82-a5c1-420c-9eec-428659a5c349 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e907ba82-a5c1-420c-9eec-428659a5c349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:14.013733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:14.014813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:14.016136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:14.016136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:14.016136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:14.016136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:14.016136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:14.016136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:14.016136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:14.016136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:14.016136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 278/529] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:14.016136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907ba82-a5c1-420c-9eec-428659a5c349 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:14.070304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bb4b8-5327-43f6-afcb-e29885f5f59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:14.072704 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bb4b8-5327-43f6-afcb-e29885f5f59f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:14.091474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:14.133386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e907ba82-a5c1-420c-9eec-428659a5c349 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:14.173453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0839ab0-adc5-459d-a160-80f40c9a9bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:14.174476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0839ab0-adc5-459d-a160-80f40c9a9bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:14.175677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0839ab0-adc5-459d-a160-80f40c9a9bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:14.176104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0839ab0-adc5-459d-a160-80f40c9a9bc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:14.177562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0839ab0-adc5-459d-a160-80f40c9a9bc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:14.178145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0839ab0-adc5-459d-a160-80f40c9a9bc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:14.180323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0839ab0-adc5-459d-a160-80f40c9a9bc6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:14.193218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:14.197413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 279/530] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:14.198622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0839ab0-adc5-459d-a160-80f40c9a9bc6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:14.201500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 252/531] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:14.202595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bb4b8-5327-43f6-afcb-e29885f5f59f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:14.321289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bb4b8-5327-43f6-afcb-e29885f5f59f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:14.323464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0839ab0-adc5-459d-a160-80f40c9a9bc6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:14.356017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:14.357489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c1ac5-042d-49b1-bf53-1845dd0210e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:14.358974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c1ac5-042d-49b1-bf53-1845dd0210e2 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:14.359356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c1ac5-042d-49b1-bf53-1845dd0210e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:14.359727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3c1ac5-042d-49b1-bf53-1845dd0210e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:14.371456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c1ac5-042d-49b1-bf53-1845dd0210e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:14.371710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508adc25-9777-45a1-aecc-d2b6d63739ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:14.372535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508adc25-9777-45a1-aecc-d2b6d63739ea None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:14.372991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508adc25-9777-45a1-aecc-d2b6d63739ea None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:14.373356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3c1ac5-042d-49b1-bf53-1845dd0210e2 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:14.373567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508adc25-9777-45a1-aecc-d2b6d63739ea None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:14.374589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508adc25-9777-45a1-aecc-d2b6d63739ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:14.375044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508adc25-9777-45a1-aecc-d2b6d63739ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:14.377324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508adc25-9777-45a1-aecc-d2b6d63739ea None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-5c3c1ac5-042d-49b1-bf53-1845dd0210e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:14.393670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:14.394761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:14.395662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:14.395662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:14.395662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:14.395662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:14.400914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 280/532] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:14.401491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 253/533] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:14.402476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c1ac5-042d-49b1-bf53-1845dd0210e2 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:14.402653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508adc25-9777-45a1-aecc-d2b6d63739ea None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:14.464026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:14.515243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3c1ac5-042d-49b1-bf53-1845dd0210e2 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:14.537215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508adc25-9777-45a1-aecc-d2b6d63739ea None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:14.558903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf051de-5fbe-4b58-9953-1feb563e09da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:14.559643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf051de-5fbe-4b58-9953-1feb563e09da None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:14.560010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf051de-5fbe-4b58-9953-1feb563e09da None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:14.560267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf051de-5fbe-4b58-9953-1feb563e09da None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:14.561100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf051de-5fbe-4b58-9953-1feb563e09da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:14.561471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf051de-5fbe-4b58-9953-1feb563e09da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:14.563147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf051de-5fbe-4b58-9953-1feb563e09da None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:14.575454 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f0542-e3da-4573-9d20-09420010a165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:14.575715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 254/534] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:14.576735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf051de-5fbe-4b58-9953-1feb563e09da None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:14.578593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f0542-e3da-4573-9d20-09420010a165 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:14.579058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f0542-e3da-4573-9d20-09420010a165 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:14.579500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f0542-e3da-4573-9d20-09420010a165 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:14.590499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f0542-e3da-4573-9d20-09420010a165 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:14.592168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f0542-e3da-4573-9d20-09420010a165 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-711f0542-e3da-4573-9d20-09420010a165 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:14.610975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:14.612266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:14.614012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:14.614012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:14.614012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:14.614012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:14.614012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:14.614012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:14.614012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:14.614012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:14.614012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 281/535] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:14.614617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f0542-e3da-4573-9d20-09420010a165 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:14.670355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:14.707252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf051de-5fbe-4b58-9953-1feb563e09da None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:14.722464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:14.736221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f0542-e3da-4573-9d20-09420010a165 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:14.745281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a63722-68de-4113-8998-08eb41de1e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:14.746182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a63722-68de-4113-8998-08eb41de1e5d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:14.746684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a63722-68de-4113-8998-08eb41de1e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:14.747600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a63722-68de-4113-8998-08eb41de1e5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:14.748456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a63722-68de-4113-8998-08eb41de1e5d None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=0edbf66359f1426999f4c28a83f2bdca) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:14.748943 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a63722-68de-4113-8998-08eb41de1e5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:14.750777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a63722-68de-4113-8998-08eb41de1e5d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:14.766530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 255/536] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:14 2022] GET /identity/v3/role_assignments?user.id=0edbf66359f1426999f4c28a83f2bdca&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:14.767585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a63722-68de-4113-8998-08eb41de1e5d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:14.776816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccd9ae-e4dd-4908-aba2-228801d59c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:14.777617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccd9ae-e4dd-4908-aba2-228801d59c42 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:14.778363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccd9ae-e4dd-4908-aba2-228801d59c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:14.778643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dccd9ae-e4dd-4908-aba2-228801d59c42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:14.786638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccd9ae-e4dd-4908-aba2-228801d59c42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:14.788104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dccd9ae-e4dd-4908-aba2-228801d59c42 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-5dccd9ae-e4dd-4908-aba2-228801d59c42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:14.805817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:14.806753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:14.807579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:14.807579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:14.807579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:14.807579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:14.807579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:14.807579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:14.807579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:14.807579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:14.807974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 282/537] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:14.813377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccd9ae-e4dd-4908-aba2-228801d59c42 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:14.994681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dccd9ae-e4dd-4908-aba2-228801d59c42 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:14.995454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a63722-68de-4113-8998-08eb41de1e5d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:14.998802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:15.037256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af40b5-f9cb-4b02-8624-d6fb68455085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:15.038192 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af40b5-f9cb-4b02-8624-d6fb68455085 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.038736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af40b5-f9cb-4b02-8624-d6fb68455085 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.039163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af40b5-f9cb-4b02-8624-d6fb68455085 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.040379 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af40b5-f9cb-4b02-8624-d6fb68455085 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:15.040838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af40b5-f9cb-4b02-8624-d6fb68455085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:15.042452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af40b5-f9cb-4b02-8624-d6fb68455085 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:15.056921 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 256/538] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:15.062269 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af40b5-f9cb-4b02-8624-d6fb68455085 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:15.072754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34064d-84c5-45f3-84c1-2f643951289c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:15.073424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34064d-84c5-45f3-84c1-2f643951289c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.073703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34064d-84c5-45f3-84c1-2f643951289c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.073976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34064d-84c5-45f3-84c1-2f643951289c None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.074799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34064d-84c5-45f3-84c1-2f643951289c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:15.075107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34064d-84c5-45f3-84c1-2f643951289c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:15.076547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34064d-84c5-45f3-84c1-2f643951289c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:15.097092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 283/539] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:15.107123 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34064d-84c5-45f3-84c1-2f643951289c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:15.115839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:15.234313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af40b5-f9cb-4b02-8624-d6fb68455085 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:15.276874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34064d-84c5-45f3-84c1-2f643951289c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:15.292035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285390c5-bb41-476a-9538-d0dd1c22704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:15.292918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285390c5-bb41-476a-9538-d0dd1c22704b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.293341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285390c5-bb41-476a-9538-d0dd1c22704b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.293791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285390c5-bb41-476a-9538-d0dd1c22704b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.294992 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285390c5-bb41-476a-9538-d0dd1c22704b None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=eacbb2c50c2c464db93b6cff7a10f7c0) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:15.297623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285390c5-bb41-476a-9538-d0dd1c22704b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:15.299262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285390c5-bb41-476a-9538-d0dd1c22704b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:15.313261 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 257/540] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:15 2022] GET /identity/v3/role_assignments?user.id=eacbb2c50c2c464db93b6cff7a10f7c0&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:15.341904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db6eaf1-7515-4dae-9a67-e8b0813a39e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:15.342868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6eaf1-7515-4dae-9a67-e8b0813a39e5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.343293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6eaf1-7515-4dae-9a67-e8b0813a39e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.343736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db6eaf1-7515-4dae-9a67-e8b0813a39e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.344741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6eaf1-7515-4dae-9a67-e8b0813a39e5 None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=e4270ab375e04196ad17f121f4175915) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:15.345227 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6eaf1-7515-4dae-9a67-e8b0813a39e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:15.347415 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db6eaf1-7515-4dae-9a67-e8b0813a39e5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:15.358602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 284/541] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:15 2022] GET /identity/v3/role_assignments?user.id=e4270ab375e04196ad17f121f4175915&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:15.964057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0619d6-48f7-402c-9186-eea85cfab5a7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.964585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0619d6-48f7-402c-9186-eea85cfab5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.964660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0619d6-48f7-402c-9186-eea85cfab5a7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.966273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 258/542] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:15.972140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82961c4-69c1-4109-aa4a-152fe483e3d6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.972537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82961c4-69c1-4109-aa4a-152fe483e3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.972716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82961c4-69c1-4109-aa4a-152fe483e3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.991842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd1b45-3ef9-4da5-8940-3b259754c0d9 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.992128 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd1b45-3ef9-4da5-8940-3b259754c0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.992401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd1b45-3ef9-4da5-8940-3b259754c0d9 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:15.993990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 259/543] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:15.994476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d82961c4-69c1-4109-aa4a-152fe483e3d6 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:15.995756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d82961c4-69c1-4109-aa4a-152fe483e3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:15.998618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cbe99-ecd4-4f5a-828b-c81c02900393 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:15.998904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cbe99-ecd4-4f5a-828b-c81c02900393 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:15.999181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693cbe99-ecd4-4f5a-828b-c81c02900393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:16.023782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-693cbe99-ecd4-4f5a-828b-c81c02900393 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:16.024977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-693cbe99-ecd4-4f5a-828b-c81c02900393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:16.059320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:16.097379 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 260/544] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:29:16.124698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 285/545] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:16.131116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cbe99-ecd4-4f5a-828b-c81c02900393 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:16.151214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82961c4-69c1-4109-aa4a-152fe483e3d6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:16.178069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:16.254365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82961c4-69c1-4109-aa4a-152fe483e3d6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:16.298789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e7d7e-0afc-4925-a85e-afbbe27ea69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:16.299598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e7d7e-0afc-4925-a85e-afbbe27ea69a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:16.300457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e7d7e-0afc-4925-a85e-afbbe27ea69a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:16.300733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32e7d7e-0afc-4925-a85e-afbbe27ea69a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:16.321973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32e7d7e-0afc-4925-a85e-afbbe27ea69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a32e7d7e-0afc-4925-a85e-afbbe27ea69a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:16.329820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:16.330710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:16.332428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:16.337172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 286/546] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:16.340138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693cbe99-ecd4-4f5a-828b-c81c02900393 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:16.348970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e7d7e-0afc-4925-a85e-afbbe27ea69a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:16.381557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e815ba-c63d-4334-946b-7f37a25da8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:16.382309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e815ba-c63d-4334-946b-7f37a25da8df None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:16.382591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e815ba-c63d-4334-946b-7f37a25da8df None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:16.382862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e815ba-c63d-4334-946b-7f37a25da8df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:16.394773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e815ba-c63d-4334-946b-7f37a25da8df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:16.395274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-46e815ba-c63d-4334-946b-7f37a25da8df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:16.403705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:16.405973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:16.407929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 261/547] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:16.414058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e815ba-c63d-4334-946b-7f37a25da8df None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:16.552928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32e7d7e-0afc-4925-a85e-afbbe27ea69a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:16.572843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:16.583713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e815ba-c63d-4334-946b-7f37a25da8df None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:16.618839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8264-7fed-4a07-ad3c-2c7c6131f715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:16.619329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87aa41-604d-4fbf-97e5-5f29d7c3baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:16.620004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87aa41-604d-4fbf-97e5-5f29d7c3baf0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:16.620283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87aa41-604d-4fbf-97e5-5f29d7c3baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:16.620523 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8264-7fed-4a07-ad3c-2c7c6131f715 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:16.620636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed87aa41-604d-4fbf-97e5-5f29d7c3baf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:16.621096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8264-7fed-4a07-ad3c-2c7c6131f715 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:16.621291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87aa41-604d-4fbf-97e5-5f29d7c3baf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:16.621597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87aa41-604d-4fbf-97e5-5f29d7c3baf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:16.621954 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8264-7fed-4a07-ad3c-2c7c6131f715 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:16.622936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8264-7fed-4a07-ad3c-2c7c6131f715 None admin] RBAC: Adding query filter params (name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:16.623036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed87aa41-604d-4fbf-97e5-5f29d7c3baf0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:16.623533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8264-7fed-4a07-ad3c-2c7c6131f715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:16.625077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537b8264-7fed-4a07-ad3c-2c7c6131f715 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:16.633999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 262/548] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:16.642632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 287/549] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:16.646075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8264-7fed-4a07-ad3c-2c7c6131f715 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:16.651041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87aa41-604d-4fbf-97e5-5f29d7c3baf0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:16.753433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8264-7fed-4a07-ad3c-2c7c6131f715 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:16.805891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60438a-e56b-4fb2-86fd-bd776015e5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:16.806719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60438a-e56b-4fb2-86fd-bd776015e5ca None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:16.807000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60438a-e56b-4fb2-86fd-bd776015e5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:16.807275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac60438a-e56b-4fb2-86fd-bd776015e5ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:16.824016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60438a-e56b-4fb2-86fd-bd776015e5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:16.825500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac60438a-e56b-4fb2-86fd-bd776015e5ca None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:16.842062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-ac60438a-e56b-4fb2-86fd-bd776015e5ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:16.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:16.856335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:16.857274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:16.857274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:16.857274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:16.857274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:16.859809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 263/550] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:16.865467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60438a-e56b-4fb2-86fd-bd776015e5ca None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:16.871145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:16.889982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed87aa41-604d-4fbf-97e5-5f29d7c3baf0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:16.983341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8664-44e5-448c-a777-dc4fcef95e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:16.984146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8664-44e5-448c-a777-dc4fcef95e9e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:16.984432 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8664-44e5-448c-a777-dc4fcef95e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:16.984705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c8664-44e5-448c-a777-dc4fcef95e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:16.997245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac60438a-e56b-4fb2-86fd-bd776015e5ca None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:17.008142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c8664-44e5-448c-a777-dc4fcef95e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:17.009471 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2c8664-44e5-448c-a777-dc4fcef95e9e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-5e2c8664-44e5-448c-a777-dc4fcef95e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:17.040248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:17.041145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:17.042184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:17.042184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:17.042184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:17.042184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:17.042184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 288/551] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:17.047124 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8664-44e5-448c-a777-dc4fcef95e9e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:17.047578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d10075-049f-4a94-99f1-f7b5dac3a367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:17.048481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d10075-049f-4a94-99f1-f7b5dac3a367 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.048966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d10075-049f-4a94-99f1-f7b5dac3a367 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.049466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d10075-049f-4a94-99f1-f7b5dac3a367 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:17.051155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d10075-049f-4a94-99f1-f7b5dac3a367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:17.051666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d10075-049f-4a94-99f1-f7b5dac3a367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:17.053258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d10075-049f-4a94-99f1-f7b5dac3a367 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:17.067505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 264/552] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:17.075166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d10075-049f-4a94-99f1-f7b5dac3a367 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:17.164609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c8664-44e5-448c-a777-dc4fcef95e9e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:17.189897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:17.195982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:17.203600 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b39c8-b333-4326-b055-2595c9614397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:17.204279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b39c8-b333-4326-b055-2595c9614397 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.204564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b39c8-b333-4326-b055-2595c9614397 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.204906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b39c8-b333-4326-b055-2595c9614397 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:17.205655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b39c8-b333-4326-b055-2595c9614397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:17.206565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b39c8-b333-4326-b055-2595c9614397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:17.207975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b39c8-b333-4326-b055-2595c9614397 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:17.226184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 289/553] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:17.228334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b39c8-b333-4326-b055-2595c9614397 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:17.271183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d10075-049f-4a94-99f1-f7b5dac3a367 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:17.343355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13232a-ba77-4264-82ae-5487fbca0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:17.344154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13232a-ba77-4264-82ae-5487fbca0839 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.344435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13232a-ba77-4264-82ae-5487fbca0839 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.344707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13232a-ba77-4264-82ae-5487fbca0839 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:17.363737 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13232a-ba77-4264-82ae-5487fbca0839 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:17.365214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13232a-ba77-4264-82ae-5487fbca0839 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:17.382167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b39c8-b333-4326-b055-2595c9614397 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-cf13232a-ba77-4264-82ae-5487fbca0839 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:17.396834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:17.397834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:17.398773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 265/554] 10.222.0.79 () {56 vars in 1093 bytes} [Wed May 25 14:29:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:17.403711 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c813-d379-46e3-a3a7-76004f4732d2 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.403997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c813-d379-46e3-a3a7-76004f4732d2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.404266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f682c813-d379-46e3-a3a7-76004f4732d2 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:17.405840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 266/555] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:17.410776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682c813-d379-46e3-a3a7-76004f4732d2 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:17.420025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db75fdf2-2076-4f94-aa05-c8b60b60f3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:17.420758 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75fdf2-2076-4f94-aa05-c8b60b60f3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.421042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75fdf2-2076-4f94-aa05-c8b60b60f3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.421320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db75fdf2-2076-4f94-aa05-c8b60b60f3b0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:17.429027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75fdf2-2076-4f94-aa05-c8b60b60f3b0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:17.430507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db75fdf2-2076-4f94-aa05-c8b60b60f3b0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-db75fdf2-2076-4f94-aa05-c8b60b60f3b0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:17.445815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:17.446799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 290/556] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:17.448622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b8d2-1d45-4b81-99b8-fea8f2a31a7c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.449265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b8d2-1d45-4b81-99b8-fea8f2a31a7c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.449265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414b8d2-1d45-4b81-99b8-fea8f2a31a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:17.472630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4414b8d2-1d45-4b81-99b8-fea8f2a31a7c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:17.473863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4414b8d2-1d45-4b81-99b8-fea8f2a31a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:17.528583 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:17.530176 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f682c813-d379-46e3-a3a7-76004f4732d2 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:17.551401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 291/557] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:17.552321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414b8d2-1d45-4b81-99b8-fea8f2a31a7c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:17.560998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:17.582706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061fbe0-2004-4608-b509-80aedadab20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:17.583849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061fbe0-2004-4608-b509-80aedadab20a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.584400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061fbe0-2004-4608-b509-80aedadab20a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.585058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061fbe0-2004-4608-b509-80aedadab20a None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:17.586170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061fbe0-2004-4608-b509-80aedadab20a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:17.586662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061fbe0-2004-4608-b509-80aedadab20a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:17.588550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061fbe0-2004-4608-b509-80aedadab20a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:17.629283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 267/558] 10.222.0.79 () {56 vars in 1133 bytes} [Wed May 25 14:29:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:17.630633 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061fbe0-2004-4608-b509-80aedadab20a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:17.663295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414b8d2-1d45-4b81-99b8-fea8f2a31a7c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:17.701347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7379f-c8bc-461b-965d-af20cfe03af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:17.702045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7379f-c8bc-461b-965d-af20cfe03af1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.702571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7379f-c8bc-461b-965d-af20cfe03af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.702842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7379f-c8bc-461b-965d-af20cfe03af1 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:17.703782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7379f-c8bc-461b-965d-af20cfe03af1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:17.704424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7379f-c8bc-461b-965d-af20cfe03af1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:17.705733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7379f-c8bc-461b-965d-af20cfe03af1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:17.729817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 292/559] 10.222.0.79 () {56 vars in 1135 bytes} [Wed May 25 14:29:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:17.729817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7379f-c8bc-461b-965d-af20cfe03af1 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:17.747472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061fbe0-2004-4608-b509-80aedadab20a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:17.774870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:17.790010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181c238-4cbd-41d3-9a54-f0ea44fe572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:17.791156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181c238-4cbd-41d3-9a54-f0ea44fe572a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.791648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181c238-4cbd-41d3-9a54-f0ea44fe572a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.792100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181c238-4cbd-41d3-9a54-f0ea44fe572a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:17.804313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181c238-4cbd-41d3-9a54-f0ea44fe572a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-0181c238-4cbd-41d3-9a54-f0ea44fe572a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:17.812836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:17.813754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:17.814602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:17.817523 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 268/560] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:17.818511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181c238-4cbd-41d3-9a54-f0ea44fe572a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:17.843150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7379f-c8bc-461b-965d-af20cfe03af1 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:17.870839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:17.886509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9a195-c1ea-4fac-a821-cceb7edab9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:17.888049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9a195-c1ea-4fac-a821-cceb7edab9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.888722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9a195-c1ea-4fac-a821-cceb7edab9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.889144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9a195-c1ea-4fac-a821-cceb7edab9a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:17.904379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9a195-c1ea-4fac-a821-cceb7edab9a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:17.906172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9a195-c1ea-4fac-a821-cceb7edab9a3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e2b9a195-c1ea-4fac-a821-cceb7edab9a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:17.929238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:17.930186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:17.931052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:17.931052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:17.931052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:17.931052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:17.931052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 293/561] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:17.931846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9a195-c1ea-4fac-a821-cceb7edab9a3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:17.947089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181c238-4cbd-41d3-9a54-f0ea44fe572a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:17.984236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df584b0-6583-495f-bd2e-00af36b83ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:17.984805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df584b0-6583-495f-bd2e-00af36b83ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:17.985082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df584b0-6583-495f-bd2e-00af36b83ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:17.985354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df584b0-6583-495f-bd2e-00af36b83ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.038706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.047703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9a195-c1ea-4fac-a821-cceb7edab9a3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.055851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df584b0-6583-495f-bd2e-00af36b83ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.057307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df584b0-6583-495f-bd2e-00af36b83ee9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.081398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31812fb-f967-4084-828c-ac530498ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.082062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31812fb-f967-4084-828c-ac530498ffff None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.082376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31812fb-f967-4084-828c-ac530498ffff None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.082648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31812fb-f967-4084-828c-ac530498ffff None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.083392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31812fb-f967-4084-828c-ac530498ffff None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:18.083699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31812fb-f967-4084-828c-ac530498ffff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.085065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31812fb-f967-4084-828c-ac530498ffff None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.092879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 294/562] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:18.093722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31812fb-f967-4084-828c-ac530498ffff None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.101931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.161525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 269/563] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:18.162970 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3144-a7bc-41d6-acae-e8821b6f35cf None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.163265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3144-a7bc-41d6-acae-e8821b6f35cf None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.163547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa3144-a7bc-41d6-acae-e8821b6f35cf None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.164805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 270/564] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:18.166068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e26c-b3d3-4ed9-8ab9-9f90f75724b5 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.166377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e26c-b3d3-4ed9-8ab9-9f90f75724b5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.166659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6e26c-b3d3-4ed9-8ab9-9f90f75724b5 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.167871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 271/565] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:18.170134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e26c-b3d3-4ed9-8ab9-9f90f75724b5 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.196450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31812fb-f967-4084-828c-ac530498ffff None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.229610 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729457f-89e2-4105-b85c-513f877371d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.230289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729457f-89e2-4105-b85c-513f877371d9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.230575 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729457f-89e2-4105-b85c-513f877371d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.230844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729457f-89e2-4105-b85c-513f877371d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.231554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729457f-89e2-4105-b85c-513f877371d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:18.231854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729457f-89e2-4105-b85c-513f877371d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.233227 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a729457f-89e2-4105-b85c-513f877371d9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.244850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 295/566] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:18.245571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729457f-89e2-4105-b85c-513f877371d9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.260710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.274316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6e26c-b3d3-4ed9-8ab9-9f90f75724b5 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.307517 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091c671d-7aa6-4fd2-bdd4-ee29396cf1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.308305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c671d-7aa6-4fd2-bdd4-ee29396cf1ba None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.308590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c671d-7aa6-4fd2-bdd4-ee29396cf1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.308867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091c671d-7aa6-4fd2-bdd4-ee29396cf1ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.319164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c671d-7aa6-4fd2-bdd4-ee29396cf1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.320604 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091c671d-7aa6-4fd2-bdd4-ee29396cf1ba None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.322310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-091c671d-7aa6-4fd2-bdd4-ee29396cf1ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:18.338985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:18.339840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:18.345503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:18.345503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:18.345503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:18.345503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:18.345503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 272/567] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:18.345503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15390d3d-c4d5-4d67-b682-f593a1756340 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.345503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15390d3d-c4d5-4d67-b682-f593a1756340 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.345503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15390d3d-c4d5-4d67-b682-f593a1756340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.345955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729457f-89e2-4105-b85c-513f877371d9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.357798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-15390d3d-c4d5-4d67-b682-f593a1756340 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:18.359025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-15390d3d-c4d5-4d67-b682-f593a1756340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:18.379117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e250fde-ceb6-4ed4-b7bc-4af91ab265a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.379911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e250fde-ceb6-4ed4-b7bc-4af91ab265a6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.380270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e250fde-ceb6-4ed4-b7bc-4af91ab265a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.380556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e250fde-ceb6-4ed4-b7bc-4af91ab265a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.390807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e250fde-ceb6-4ed4-b7bc-4af91ab265a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.392247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e250fde-ceb6-4ed4-b7bc-4af91ab265a6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3e250fde-ceb6-4ed4-b7bc-4af91ab265a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:18.410232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:18.411276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:18.412151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:18.412151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:18.412151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:18.412151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:18.412151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 296/568] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:18.412540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91799ae1-0f24-40d7-9fe4-c929b19c9e7f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.412814 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91799ae1-0f24-40d7-9fe4-c929b19c9e7f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.413088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91799ae1-0f24-40d7-9fe4-c929b19c9e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.426055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 273/569] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:18.427255 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15390d3d-c4d5-4d67-b682-f593a1756340 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.435591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-91799ae1-0f24-40d7-9fe4-c929b19c9e7f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:18.437049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-91799ae1-0f24-40d7-9fe4-c929b19c9e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:18.496868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.505537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 297/570] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:18.506552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91799ae1-0f24-40d7-9fe4-c929b19c9e7f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.538596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15390d3d-c4d5-4d67-b682-f593a1756340 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.562069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.573150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92ae6e-9058-4666-910b-7b3576b3f038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.573944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92ae6e-9058-4666-910b-7b3576b3f038 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.574251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92ae6e-9058-4666-910b-7b3576b3f038 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.574524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92ae6e-9058-4666-910b-7b3576b3f038 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.581476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92ae6e-9058-4666-910b-7b3576b3f038 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.582957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92ae6e-9058-4666-910b-7b3576b3f038 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-5b92ae6e-9058-4666-910b-7b3576b3f038 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:18.597236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:18.598339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:18.599233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:18.599233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:18.599233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:18.599233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:18.599233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:18.599233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:18.599233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:18.599233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:18.599233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 274/571] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:18.599233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92ae6e-9058-4666-910b-7b3576b3f038 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.610167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91799ae1-0f24-40d7-9fe4-c929b19c9e7f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.645016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe58d45-837b-4fc2-ad12-ad24c7f34c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.645682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe58d45-837b-4fc2-ad12-ad24c7f34c37 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.645963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe58d45-837b-4fc2-ad12-ad24c7f34c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.646269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe58d45-837b-4fc2-ad12-ad24c7f34c37 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.646991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe58d45-837b-4fc2-ad12-ad24c7f34c37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:18.647303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe58d45-837b-4fc2-ad12-ad24c7f34c37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.648679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe58d45-837b-4fc2-ad12-ad24c7f34c37 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.659660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 298/572] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:18.660423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe58d45-837b-4fc2-ad12-ad24c7f34c37 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.701707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92ae6e-9058-4666-910b-7b3576b3f038 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.714357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.734049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177400f-05f5-421b-b188-9b08ce58035a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.734726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177400f-05f5-421b-b188-9b08ce58035a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.735005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177400f-05f5-421b-b188-9b08ce58035a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.735278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177400f-05f5-421b-b188-9b08ce58035a None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.735990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177400f-05f5-421b-b188-9b08ce58035a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:18.736295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177400f-05f5-421b-b188-9b08ce58035a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.738224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177400f-05f5-421b-b188-9b08ce58035a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.749535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 275/573] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:18.750283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177400f-05f5-421b-b188-9b08ce58035a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.763428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe58d45-837b-4fc2-ad12-ad24c7f34c37 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.793922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.802238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ca89b-3e00-472a-afd5-b2f6a88ee0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.803033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ca89b-3e00-472a-afd5-b2f6a88ee0fd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.803313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ca89b-3e00-472a-afd5-b2f6a88ee0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.803584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841ca89b-3e00-472a-afd5-b2f6a88ee0fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.813312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841ca89b-3e00-472a-afd5-b2f6a88ee0fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-841ca89b-3e00-472a-afd5-b2f6a88ee0fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:18.821596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:18.822729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:18.823554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:18.826697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 299/574] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:18.827532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ca89b-3e00-472a-afd5-b2f6a88ee0fd None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.848664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177400f-05f5-421b-b188-9b08ce58035a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.882337 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6cb13-2ee0-4711-823c-9025596ba9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.883131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6cb13-2ee0-4711-823c-9025596ba9aa None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.883409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6cb13-2ee0-4711-823c-9025596ba9aa None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.883678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6cb13-2ee0-4711-823c-9025596ba9aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.893904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6cb13-2ee0-4711-823c-9025596ba9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-3bf6cb13-2ee0-4711-823c-9025596ba9aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:18.901751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:18.902853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 276/575] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:18.903875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6cb13-2ee0-4711-823c-9025596ba9aa None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:18.935154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841ca89b-3e00-472a-afd5-b2f6a88ee0fd None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:18.950637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:18.968298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae27d0-01a3-473d-947a-71993423145d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:18.968957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae27d0-01a3-473d-947a-71993423145d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:18.969240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae27d0-01a3-473d-947a-71993423145d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:18.969519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae27d0-01a3-473d-947a-71993423145d None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:18.970399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae27d0-01a3-473d-947a-71993423145d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:18.970709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae27d0-01a3-473d-947a-71993423145d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:18.972660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae27d0-01a3-473d-947a-71993423145d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:18.984304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 300/576] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:18.985092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae27d0-01a3-473d-947a-71993423145d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.002622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6cb13-2ee0-4711-823c-9025596ba9aa None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.005357 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:19.036829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed7f40-9a17-4a27-bfea-f4b03e37e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.037612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed7f40-9a17-4a27-bfea-f4b03e37e569 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.037892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed7f40-9a17-4a27-bfea-f4b03e37e569 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.038198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed7f40-9a17-4a27-bfea-f4b03e37e569 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.045795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed7f40-9a17-4a27-bfea-f4b03e37e569 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.047274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed7f40-9a17-4a27-bfea-f4b03e37e569 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-5aed7f40-9a17-4a27-bfea-f4b03e37e569 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:19.061056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:19.062729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 277/577] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:19.064050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed7f40-9a17-4a27-bfea-f4b03e37e569 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.087107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae27d0-01a3-473d-947a-71993423145d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.120888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4a416-e4a7-465b-ac3b-0232d3ea1bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.121732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4a416-e4a7-465b-ac3b-0232d3ea1bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.121945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4a416-e4a7-465b-ac3b-0232d3ea1bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.122242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4a416-e4a7-465b-ac3b-0232d3ea1bc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.129198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4a416-e4a7-465b-ac3b-0232d3ea1bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.130694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4a416-e4a7-465b-ac3b-0232d3ea1bc7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-87e4a416-e4a7-465b-ac3b-0232d3ea1bc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:19.145037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:19.146117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:19.147371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:19.147371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:19.147371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:19.147371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:19.147371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:19.147371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:19.147371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:19.147371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:19.147371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 301/578] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:19.147371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4a416-e4a7-465b-ac3b-0232d3ea1bc7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.168415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed7f40-9a17-4a27-bfea-f4b03e37e569 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.181675 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:19.202804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbde65-834b-43a0-b4d6-f4e341b125d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.203465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbde65-834b-43a0-b4d6-f4e341b125d5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.203747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbde65-834b-43a0-b4d6-f4e341b125d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.204022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbde65-834b-43a0-b4d6-f4e341b125d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.204761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbde65-834b-43a0-b4d6-f4e341b125d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:19.205066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbde65-834b-43a0-b4d6-f4e341b125d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.207008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbde65-834b-43a0-b4d6-f4e341b125d5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.214723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 278/579] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:19.215471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbde65-834b-43a0-b4d6-f4e341b125d5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.241259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:19.244800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4a416-e4a7-465b-ac3b-0232d3ea1bc7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.278060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef18da-fb99-4241-936f-d2c4b302f764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.278690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef18da-fb99-4241-936f-d2c4b302f764 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.279036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef18da-fb99-4241-936f-d2c4b302f764 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.279320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef18da-fb99-4241-936f-d2c4b302f764 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.280062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef18da-fb99-4241-936f-d2c4b302f764 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:19.280376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef18da-fb99-4241-936f-d2c4b302f764 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.281758 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef18da-fb99-4241-936f-d2c4b302f764 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.290674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 302/580] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:19.291449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef18da-fb99-4241-936f-d2c4b302f764 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.313384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbde65-834b-43a0-b4d6-f4e341b125d5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.346293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baaac3-7c6f-4007-b2bf-573a9d3b69ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.347183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baaac3-7c6f-4007-b2bf-573a9d3b69ed None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.347470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baaac3-7c6f-4007-b2bf-573a9d3b69ed None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.347751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baaac3-7c6f-4007-b2bf-573a9d3b69ed None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/eb66b6f6b5524f3687411fa83d525acc/roles/f4c0968e3f8b4988a9f32d8ef25d481b` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.361675 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baaac3-7c6f-4007-b2bf-573a9d3b69ed None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=eb66b6f6b5524f3687411fa83d525acc, role_id=f4c0968e3f8b4988a9f32d8ef25d481b)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.363668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baaac3-7c6f-4007-b2bf-573a9d3b69ed None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.375976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 279/581] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:29:19 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/eb66b6f6b5524f3687411fa83d525acc/roles/f4c0968e3f8b4988a9f32d8ef25d481b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:19.376760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baaac3-7c6f-4007-b2bf-573a9d3b69ed None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.390829 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:19.395610 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef18da-fb99-4241-936f-d2c4b302f764 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.435950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db32ab-dfc4-4181-9dbd-9da72972875d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.436648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db32ab-dfc4-4181-9dbd-9da72972875d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.436938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db32ab-dfc4-4181-9dbd-9da72972875d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.437219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db32ab-dfc4-4181-9dbd-9da72972875d None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.438701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db32ab-dfc4-4181-9dbd-9da72972875d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:19.439032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db32ab-dfc4-4181-9dbd-9da72972875d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.441274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db32ab-dfc4-4181-9dbd-9da72972875d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.466345 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 303/582] 10.222.0.79 () {56 vars in 1137 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:19.466345 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db32ab-dfc4-4181-9dbd-9da72972875d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.469928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:19.497524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baaac3-7c6f-4007-b2bf-573a9d3b69ed None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.534289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e187e0-405a-495a-bec1-deaab92d941a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.535075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e187e0-405a-495a-bec1-deaab92d941a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.535305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e187e0-405a-495a-bec1-deaab92d941a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.535589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e187e0-405a-495a-bec1-deaab92d941a None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.536393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e187e0-405a-495a-bec1-deaab92d941a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:19.536701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e187e0-405a-495a-bec1-deaab92d941a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.538244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e187e0-405a-495a-bec1-deaab92d941a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.552452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 280/583] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:19.553761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e187e0-405a-495a-bec1-deaab92d941a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.584872 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db32ab-dfc4-4181-9dbd-9da72972875d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.622251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7409f02-cbee-42df-af61-67ceb3877d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.623052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409f02-cbee-42df-af61-67ceb3877d81 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.623336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409f02-cbee-42df-af61-67ceb3877d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.623613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409f02-cbee-42df-af61-67ceb3877d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.634551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7409f02-cbee-42df-af61-67ceb3877d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.636281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7409f02-cbee-42df-af61-67ceb3877d81 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a7409f02-cbee-42df-af61-67ceb3877d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:19.653939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:19.654869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:19.655760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:19.655760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:19.655760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:19.655760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:19.655760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 304/584] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:19.656027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7409f02-cbee-42df-af61-67ceb3877d81 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.664000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e187e0-405a-495a-bec1-deaab92d941a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.667674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:19.699687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dadbe-35f6-463e-b98e-4fcc96569491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.700837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dadbe-35f6-463e-b98e-4fcc96569491 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.700837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dadbe-35f6-463e-b98e-4fcc96569491 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.701083 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680dadbe-35f6-463e-b98e-4fcc96569491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.703822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:19.712852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dadbe-35f6-463e-b98e-4fcc96569491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.714442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680dadbe-35f6-463e-b98e-4fcc96569491 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-680dadbe-35f6-463e-b98e-4fcc96569491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:19.732555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:19.733488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:19.734757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:19.734757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:19.734757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:19.734757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:19.734757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 281/585] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:19.734757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dadbe-35f6-463e-b98e-4fcc96569491 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.772452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7409f02-cbee-42df-af61-67ceb3877d81 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.807854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8dfef-8575-46d3-8b9e-89473a41b23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.808571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8dfef-8575-46d3-8b9e-89473a41b23e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.808854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8dfef-8575-46d3-8b9e-89473a41b23e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.809132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec8dfef-8575-46d3-8b9e-89473a41b23e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.819626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8dfef-8575-46d3-8b9e-89473a41b23e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.821077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec8dfef-8575-46d3-8b9e-89473a41b23e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-eec8dfef-8575-46d3-8b9e-89473a41b23e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:19.839106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:19.840031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:19.840898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:19.840898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:19.840898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:19.840898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:19.843465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 305/586] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:19.844313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8dfef-8575-46d3-8b9e-89473a41b23e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.850649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680dadbe-35f6-463e-b98e-4fcc96569491 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.887933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3517a-092b-4f98-ae9a-2f20b9d36190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:19.888591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3517a-092b-4f98-ae9a-2f20b9d36190 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:19.888876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3517a-092b-4f98-ae9a-2f20b9d36190 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:19.889155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b3517a-092b-4f98-ae9a-2f20b9d36190 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:19.889988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3517a-092b-4f98-ae9a-2f20b9d36190 None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=fa04ddd7a6ce4bbabdfca31721b9c71d) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:19.890350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3517a-092b-4f98-ae9a-2f20b9d36190 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:19.891797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b3517a-092b-4f98-ae9a-2f20b9d36190 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:19.897600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 282/587] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/role_assignments?user.id=fa04ddd7a6ce4bbabdfca31721b9c71d&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:19.903198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3517a-092b-4f98-ae9a-2f20b9d36190 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:19.913392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:19.962553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec8dfef-8575-46d3-8b9e-89473a41b23e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:19.985030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:20.005000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0e04f-35b7-480a-bef7-3a408ea2bb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:20.005679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0e04f-35b7-480a-bef7-3a408ea2bb2d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:20.006572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0e04f-35b7-480a-bef7-3a408ea2bb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:20.006572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e0e04f-35b7-480a-bef7-3a408ea2bb2d None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:20.007186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0e04f-35b7-480a-bef7-3a408ea2bb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:20.007496 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0e04f-35b7-480a-bef7-3a408ea2bb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:20.008929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e0e04f-35b7-480a-bef7-3a408ea2bb2d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:20.023479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 306/588] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:20.024353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0e04f-35b7-480a-bef7-3a408ea2bb2d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:20.054440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b3517a-092b-4f98-ae9a-2f20b9d36190 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:20.094764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9356-5b72-40f5-ad69-509ed7d43246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:20.095365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9356-5b72-40f5-ad69-509ed7d43246 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:20.095635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9356-5b72-40f5-ad69-509ed7d43246 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:20.095908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a9356-5b72-40f5-ad69-509ed7d43246 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:20.097215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9356-5b72-40f5-ad69-509ed7d43246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:20.097523 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9356-5b72-40f5-ad69-509ed7d43246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:20.100042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a9356-5b72-40f5-ad69-509ed7d43246 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:20.112241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 283/589] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:20.113061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9356-5b72-40f5-ad69-509ed7d43246 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:20.169585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e0e04f-35b7-480a-bef7-3a408ea2bb2d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:20.198423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:20.218070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee81c6-5d81-4f48-aed5-5260f7aac893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:20.219330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee81c6-5d81-4f48-aed5-5260f7aac893 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:20.220174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee81c6-5d81-4f48-aed5-5260f7aac893 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:20.221052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee81c6-5d81-4f48-aed5-5260f7aac893 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:20.223017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee81c6-5d81-4f48-aed5-5260f7aac893 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:20.223797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee81c6-5d81-4f48-aed5-5260f7aac893 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:20.226101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee81c6-5d81-4f48-aed5-5260f7aac893 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:20.230547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a9356-5b72-40f5-ad69-509ed7d43246 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:20.243090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 307/590] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:20.244533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee81c6-5d81-4f48-aed5-5260f7aac893 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:20.245635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:20.278697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7594ea-3a3a-43c3-8081-cf2ee8215ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:20.280183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7594ea-3a3a-43c3-8081-cf2ee8215ffd None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:20.280924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7594ea-3a3a-43c3-8081-cf2ee8215ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:20.281821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7594ea-3a3a-43c3-8081-cf2ee8215ffd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:20.292051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7594ea-3a3a-43c3-8081-cf2ee8215ffd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:20.294372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7594ea-3a3a-43c3-8081-cf2ee8215ffd None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-dd7594ea-3a3a-43c3-8081-cf2ee8215ffd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:20.317584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:20.318568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:20.319503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:20.319503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:20.319503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:20.319503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:20.319503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:20.319503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:20.319503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:20.319503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:20.319503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:29:20.319503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:20.320010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 284/591] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:20.320667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7594ea-3a3a-43c3-8081-cf2ee8215ffd None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:20.359499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee81c6-5d81-4f48-aed5-5260f7aac893 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:20.403993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd015e1-41b9-4dde-897a-0f4a4ae14851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:20.405380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd015e1-41b9-4dde-897a-0f4a4ae14851 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:20.405848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd015e1-41b9-4dde-897a-0f4a4ae14851 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:20.406318 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd015e1-41b9-4dde-897a-0f4a4ae14851 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:20.417203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd015e1-41b9-4dde-897a-0f4a4ae14851 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:20.419428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd015e1-41b9-4dde-897a-0f4a4ae14851 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-bfd015e1-41b9-4dde-897a-0f4a4ae14851 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:20.439723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:20.441217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:20.442141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:20.442141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:20.442141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:20.442141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:20.442141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:20.442141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:20.442141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:20.442141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:20.442141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:29:20.442141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:20.442669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7594ea-3a3a-43c3-8081-cf2ee8215ffd None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:20.445526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 308/592] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:20.446565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd015e1-41b9-4dde-897a-0f4a4ae14851 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:20.479889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceea60d-e396-4e26-a1e2-2bc0879eb296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:20.480848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceea60d-e396-4e26-a1e2-2bc0879eb296 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:20.481235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceea60d-e396-4e26-a1e2-2bc0879eb296 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:20.481621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceea60d-e396-4e26-a1e2-2bc0879eb296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:20.489657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceea60d-e396-4e26-a1e2-2bc0879eb296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:20.491266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceea60d-e396-4e26-a1e2-2bc0879eb296 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:20.503654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-7ceea60d-e396-4e26-a1e2-2bc0879eb296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:20.505507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:20.506561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:20.507623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:20.507623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:20.507623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:20.507623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:20.507623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:20.507623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:20.507623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:20.507623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:20.510555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 285/593] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:20.511437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceea60d-e396-4e26-a1e2-2bc0879eb296 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:20.549103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:20.579618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd015e1-41b9-4dde-897a-0f4a4ae14851 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:20.616315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2e6e7-b426-4edb-a279-f41fd57d87b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:20.616680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2e6e7-b426-4edb-a279-f41fd57d87b8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:20.616958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2e6e7-b426-4edb-a279-f41fd57d87b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:20.617230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a2e6e7-b426-4edb-a279-f41fd57d87b8 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:20.618068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2e6e7-b426-4edb-a279-f41fd57d87b8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:20.618411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2e6e7-b426-4edb-a279-f41fd57d87b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:20.619908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a2e6e7-b426-4edb-a279-f41fd57d87b8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:20.643545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 309/594] 10.222.0.79 () {56 vars in 1137 bytes} [Wed May 25 14:29:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:20.644400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2e6e7-b426-4edb-a279-f41fd57d87b8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:20.650548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceea60d-e396-4e26-a1e2-2bc0879eb296 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:20.697887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d0e0-6432-49e7-84ba-141b20ee92cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:20.698846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d0e0-6432-49e7-84ba-141b20ee92cb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:20.699812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d0e0-6432-49e7-84ba-141b20ee92cb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:20.700268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23d0e0-6432-49e7-84ba-141b20ee92cb None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:20.701564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23d0e0-6432-49e7-84ba-141b20ee92cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:20.702266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23d0e0-6432-49e7-84ba-141b20ee92cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:20.704584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23d0e0-6432-49e7-84ba-141b20ee92cb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:20.725250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 286/595] 10.222.0.79 () {56 vars in 1139 bytes} [Wed May 25 14:29:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:20.726328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d0e0-6432-49e7-84ba-141b20ee92cb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:20.756894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:20.762432 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a2e6e7-b426-4edb-a279-f41fd57d87b8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:20.812074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a5e41-0cac-48b5-a341-66e14746f210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:20.813280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a5e41-0cac-48b5-a341-66e14746f210 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:20.813965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a5e41-0cac-48b5-a341-66e14746f210 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:20.814424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a5e41-0cac-48b5-a341-66e14746f210 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:20.815758 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a5e41-0cac-48b5-a341-66e14746f210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:20.816230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a5e41-0cac-48b5-a341-66e14746f210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:20.818412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a5e41-0cac-48b5-a341-66e14746f210 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:20.820393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:20.830487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23d0e0-6432-49e7-84ba-141b20ee92cb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:20.836756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 310/596] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:20.837744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a5e41-0cac-48b5-a341-66e14746f210 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:20.881875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2efc-3301-42e6-bbe7-d72dc01fd565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:20.882665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2efc-3301-42e6-bbe7-d72dc01fd565 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:20.882948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2efc-3301-42e6-bbe7-d72dc01fd565 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:20.883230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa2efc-3301-42e6-bbe7-d72dc01fd565 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:20.894649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2efc-3301-42e6-bbe7-d72dc01fd565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:20.896214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fa2efc-3301-42e6-bbe7-d72dc01fd565 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-35fa2efc-3301-42e6-bbe7-d72dc01fd565 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:20.915087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:20.916210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:20.917166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:20.917166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:20.917166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:20.917166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:20.917166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 287/597] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:20.917471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2efc-3301-42e6-bbe7-d72dc01fd565 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:20.958108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a5e41-0cac-48b5-a341-66e14746f210 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.003931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927eb6a-7776-40b6-bb4e-3b8e969afcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.004944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927eb6a-7776-40b6-bb4e-3b8e969afcce None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.005608 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927eb6a-7776-40b6-bb4e-3b8e969afcce None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.005892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927eb6a-7776-40b6-bb4e-3b8e969afcce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.020633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927eb6a-7776-40b6-bb4e-3b8e969afcce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.022772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927eb6a-7776-40b6-bb4e-3b8e969afcce None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.024757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fa2efc-3301-42e6-bbe7-d72dc01fd565 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-4927eb6a-7776-40b6-bb4e-3b8e969afcce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:21.044771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:21.046934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:21.049063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:21.049063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:21.049063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:21.049063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:21.049063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 311/598] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:21.049063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927eb6a-7776-40b6-bb4e-3b8e969afcce None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.062699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80a7d8-e303-44ad-a992-cab4c3f86656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.063752 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80a7d8-e303-44ad-a992-cab4c3f86656 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.064033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80a7d8-e303-44ad-a992-cab4c3f86656 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.064547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:21.065664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f80a7d8-e303-44ad-a992-cab4c3f86656 None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/0edbf66359f1426999f4c28a83f2bdca/roles/f4c0968e3f8b4988a9f32d8ef25d481b` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.081691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:21.087204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80a7d8-e303-44ad-a992-cab4c3f86656 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=0edbf66359f1426999f4c28a83f2bdca, role_id=f4c0968e3f8b4988a9f32d8ef25d481b)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.088994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f80a7d8-e303-44ad-a992-cab4c3f86656 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.104842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 288/599] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:29:20 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/0edbf66359f1426999f4c28a83f2bdca/roles/f4c0968e3f8b4988a9f32d8ef25d481b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:21.106729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80a7d8-e303-44ad-a992-cab4c3f86656 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.163836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927eb6a-7776-40b6-bb4e-3b8e969afcce None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.201616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ac611-8896-4fb4-a67e-e38490a13a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.202334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ac611-8896-4fb4-a67e-e38490a13a3b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.202886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ac611-8896-4fb4-a67e-e38490a13a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.203013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ac611-8896-4fb4-a67e-e38490a13a3b None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.203670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ac611-8896-4fb4-a67e-e38490a13a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:21.203981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ac611-8896-4fb4-a67e-e38490a13a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.205379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ac611-8896-4fb4-a67e-e38490a13a3b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.222491 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 312/600] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:21.228013 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f80a7d8-e303-44ad-a992-cab4c3f86656 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.245745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ac611-8896-4fb4-a67e-e38490a13a3b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.269091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfb028-ba51-4662-b753-05af981abebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.270138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfb028-ba51-4662-b753-05af981abebc None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.270597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfb028-ba51-4662-b753-05af981abebc None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.271080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfb028-ba51-4662-b753-05af981abebc None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.271977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfb028-ba51-4662-b753-05af981abebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:21.272435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfb028-ba51-4662-b753-05af981abebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.274030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfb028-ba51-4662-b753-05af981abebc None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.291908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 289/601] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:21.293427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfb028-ba51-4662-b753-05af981abebc None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.330553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:21.358915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:21.382387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ac611-8896-4fb4-a67e-e38490a13a3b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.427215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66050116-c52c-4014-9e43-d91e8754e955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.427942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66050116-c52c-4014-9e43-d91e8754e955 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.428277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66050116-c52c-4014-9e43-d91e8754e955 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.428557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66050116-c52c-4014-9e43-d91e8754e955 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.430403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfb028-ba51-4662-b753-05af981abebc None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.436072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66050116-c52c-4014-9e43-d91e8754e955 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.437565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66050116-c52c-4014-9e43-d91e8754e955 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-66050116-c52c-4014-9e43-d91e8754e955 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:21.453627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:21.454659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:21.455512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:21.455512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:21.455512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:21.455512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:21.455512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:21.455512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:21.455512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:21.455512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:21.455512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 313/602] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:21.462132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66050116-c52c-4014-9e43-d91e8754e955 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.474383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6606d3-610b-421c-a32a-105cf8439d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.475588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6606d3-610b-421c-a32a-105cf8439d1f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.476088 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6606d3-610b-421c-a32a-105cf8439d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.476569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6606d3-610b-421c-a32a-105cf8439d1f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.484577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6606d3-610b-421c-a32a-105cf8439d1f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.486562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6606d3-610b-421c-a32a-105cf8439d1f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-6d6606d3-610b-421c-a32a-105cf8439d1f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:21.503716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:21.504623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:21.505467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:21.505467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:21.505467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:21.505467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:21.505467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:21.505467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:21.505467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:21.505467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:21.507908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 290/603] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:21.514812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6606d3-610b-421c-a32a-105cf8439d1f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.638003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66050116-c52c-4014-9e43-d91e8754e955 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.679355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:21.685740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faecb658-916a-4ea3-909a-329bdca12e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.686512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb658-916a-4ea3-909a-329bdca12e7f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.686869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb658-916a-4ea3-909a-329bdca12e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.687248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecb658-916a-4ea3-909a-329bdca12e7f None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.688171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecb658-916a-4ea3-909a-329bdca12e7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:21.688680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecb658-916a-4ea3-909a-329bdca12e7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.689123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6606d3-610b-421c-a32a-105cf8439d1f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.690459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faecb658-916a-4ea3-909a-329bdca12e7f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.703365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:21.704719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 314/604] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:21.710535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82974e-aade-4a32-a228-663b65657d39 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.710833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82974e-aade-4a32-a228-663b65657d39 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.711111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f82974e-aade-4a32-a228-663b65657d39 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.713410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 315/605] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:21.714147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82974e-aade-4a32-a228-663b65657d39 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.732041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe934f4b-6597-40db-8130-0080eebe3ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.732710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe934f4b-6597-40db-8130-0080eebe3ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.732992 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe934f4b-6597-40db-8130-0080eebe3ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.733365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe934f4b-6597-40db-8130-0080eebe3ba9 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.734285 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe934f4b-6597-40db-8130-0080eebe3ba9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:21.734603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe934f4b-6597-40db-8130-0080eebe3ba9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.736051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe934f4b-6597-40db-8130-0080eebe3ba9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.749474 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 291/606] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:21.750893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4095b-d9c5-4a33-b7c6-913d70b8844e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.751186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4095b-d9c5-4a33-b7c6-913d70b8844e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.751561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4095b-d9c5-4a33-b7c6-913d70b8844e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.769890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-6ee4095b-d9c5-4a33-b7c6-913d70b8844e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:21.771111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6ee4095b-d9c5-4a33-b7c6-913d70b8844e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:21.822487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f82974e-aade-4a32-a228-663b65657d39 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:21.844196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 292/607] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:21.845037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4095b-d9c5-4a33-b7c6-913d70b8844e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.870863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31601f-63df-456a-a50f-661ce65783d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:21.871753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31601f-63df-456a-a50f-661ce65783d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:21.872054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31601f-63df-456a-a50f-661ce65783d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:21.872298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31601f-63df-456a-a50f-661ce65783d1 None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/eacbb2c50c2c464db93b6cff7a10f7c0/roles/f4c0968e3f8b4988a9f32d8ef25d481b` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:21.889266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31601f-63df-456a-a50f-661ce65783d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=eacbb2c50c2c464db93b6cff7a10f7c0, role_id=f4c0968e3f8b4988a9f32d8ef25d481b)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:21.890749 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31601f-63df-456a-a50f-661ce65783d1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:21.909158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 316/608] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:29:21 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/eacbb2c50c2c464db93b6cff7a10f7c0/roles/f4c0968e3f8b4988a9f32d8ef25d481b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:21.909999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31601f-63df-456a-a50f-661ce65783d1 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:21.960701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:22.030497 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31601f-63df-456a-a50f-661ce65783d1 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:22.046772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4095b-d9c5-4a33-b7c6-913d70b8844e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:22.048975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:22.074055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cfda4-fa7e-479f-b8de-5e37b1488c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:22.074893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cfda4-fa7e-479f-b8de-5e37b1488c19 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:22.075172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cfda4-fa7e-479f-b8de-5e37b1488c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:22.075443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cfda4-fa7e-479f-b8de-5e37b1488c19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:22.088756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283cfda4-fa7e-479f-b8de-5e37b1488c19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-283cfda4-fa7e-479f-b8de-5e37b1488c19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:22.098273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:22.099268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:22.100109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:22.101326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 317/609] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:22.107649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cfda4-fa7e-479f-b8de-5e37b1488c19 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:22.134388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b5bb6-9a23-477b-8491-e467d8849dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:22.135571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5bb6-9a23-477b-8491-e467d8849dc8 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:22.135853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5bb6-9a23-477b-8491-e467d8849dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:22.136125 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2b5bb6-9a23-477b-8491-e467d8849dc8 None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/e4270ab375e04196ad17f121f4175915/roles/f4c0968e3f8b4988a9f32d8ef25d481b` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:22.179867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b5bb6-9a23-477b-8491-e467d8849dc8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=e4270ab375e04196ad17f121f4175915, role_id=f4c0968e3f8b4988a9f32d8ef25d481b)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:22.181632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2b5bb6-9a23-477b-8491-e467d8849dc8 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:22.207299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 293/610] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:29:21 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/e4270ab375e04196ad17f121f4175915/roles/f4c0968e3f8b4988a9f32d8ef25d481b => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:22.264125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:22.267103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cfda4-fa7e-479f-b8de-5e37b1488c19 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:22.306743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7d187-0883-40cf-be07-99c7a90748ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:22.307499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7d187-0883-40cf-be07-99c7a90748ef None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:22.307779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7d187-0883-40cf-be07-99c7a90748ef None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:22.308052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7d187-0883-40cf-be07-99c7a90748ef None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:22.308930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7d187-0883-40cf-be07-99c7a90748ef None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:22.309284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7d187-0883-40cf-be07-99c7a90748ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:22.310743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7d187-0883-40cf-be07-99c7a90748ef None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:22.320808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 318/611] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:22.326403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b5bb6-9a23-477b-8491-e467d8849dc8 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:22.360207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2657b1-762e-489c-9e0b-f0c201778a7e None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:22.360593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2657b1-762e-489c-9e0b-f0c201778a7e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:22.360944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2657b1-762e-489c-9e0b-f0c201778a7e None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:22.363358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 319/612] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:22.368693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81159d02-497c-43e0-959b-b342b1c4c1b2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:22.369053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81159d02-497c-43e0-959b-b342b1c4c1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:22.369402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81159d02-497c-43e0-959b-b342b1c4c1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:22.400696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-81159d02-497c-43e0-959b-b342b1c4c1b2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:22.401975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-81159d02-497c-43e0-959b-b342b1c4c1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:22.472179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2b5bb6-9a23-477b-8491-e467d8849dc8 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:22.506330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670599c-3aa6-4078-b1b9-3377de195b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:22.507113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670599c-3aa6-4078-b1b9-3377de195b37 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:22.507391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670599c-3aa6-4078-b1b9-3377de195b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:22.507666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670599c-3aa6-4078-b1b9-3377de195b37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:22.519207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 320/613] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:29:22.519358 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670599c-3aa6-4078-b1b9-3377de195b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:22.521774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670599c-3aa6-4078-b1b9-3377de195b37 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-9670599c-3aa6-4078-b1b9-3377de195b37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:22.538856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:22.539770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:22.540649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:22.540649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:22.540649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:22.540649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:22.540649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 294/614] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:22.545485 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81159d02-497c-43e0-959b-b342b1c4c1b2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:22.548879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670599c-3aa6-4078-b1b9-3377de195b37 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:22.553581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:22.667756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670599c-3aa6-4078-b1b9-3377de195b37 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:22.705157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62f688-708a-4557-9f69-36784dbb367a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:22.706446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62f688-708a-4557-9f69-36784dbb367a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:22.706949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62f688-708a-4557-9f69-36784dbb367a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:22.707433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62f688-708a-4557-9f69-36784dbb367a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:22.718820 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e62f688-708a-4557-9f69-36784dbb367a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-9e62f688-708a-4557-9f69-36784dbb367a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:22.727862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:22.728786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:22.729591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:22.732313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 295/615] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:22.737988 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:22.738983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62f688-708a-4557-9f69-36784dbb367a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:22.756896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81159d02-497c-43e0-959b-b342b1c4c1b2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:22.791791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a62955-1b99-436e-992b-594f2f18a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:22.792378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a62955-1b99-436e-992b-594f2f18a695 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:22.792656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a62955-1b99-436e-992b-594f2f18a695 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:22.793141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a62955-1b99-436e-992b-594f2f18a695 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:22.793851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a62955-1b99-436e-992b-594f2f18a695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:22.794144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a62955-1b99-436e-992b-594f2f18a695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:22.795607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a62955-1b99-436e-992b-594f2f18a695 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:22.815690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:22.817480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 321/616] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:22.827230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a62955-1b99-436e-992b-594f2f18a695 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:22.863511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e62f688-708a-4557-9f69-36784dbb367a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:22.902108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abae8f1-16f5-47e9-827a-ebb1919b9705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:22.902108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abae8f1-16f5-47e9-827a-ebb1919b9705 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:22.902108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abae8f1-16f5-47e9-827a-ebb1919b9705 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:22.902108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abae8f1-16f5-47e9-827a-ebb1919b9705 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:22.902533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abae8f1-16f5-47e9-827a-ebb1919b9705 None admin] RBAC: Adding query filter params (name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:22.902533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abae8f1-16f5-47e9-827a-ebb1919b9705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:22.902533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abae8f1-16f5-47e9-827a-ebb1919b9705 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:22.912112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 296/617] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:22.917676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abae8f1-16f5-47e9-827a-ebb1919b9705 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:23.002525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a62955-1b99-436e-992b-594f2f18a695 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:23.069675 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8f71-c60e-4a2f-9292-e89fe25bd829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:23.070416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8f71-c60e-4a2f-9292-e89fe25bd829 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:23.070698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8f71-c60e-4a2f-9292-e89fe25bd829 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:23.070972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be8f71-c60e-4a2f-9292-e89fe25bd829 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:23.086929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abae8f1-16f5-47e9-827a-ebb1919b9705 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:23.089209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8f71-c60e-4a2f-9292-e89fe25bd829 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:23.090700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be8f71-c60e-4a2f-9292-e89fe25bd829 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c4be8f71-c60e-4a2f-9292-e89fe25bd829 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:23.124789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:23.125771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:23.126793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:23.126793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:23.126793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:23.126793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:23.126793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:23.126793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:23.126793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:23.126793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:23.126793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:23.126793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:23.129214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 322/618] 10.222.0.79 () {56 vars in 1093 bytes} [Wed May 25 14:29:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:23.131294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8f71-c60e-4a2f-9292-e89fe25bd829 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:23.136152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:23.153713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b8fd8-0fb9-4e6a-8501-35480e9734bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:23.155662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b8fd8-0fb9-4e6a-8501-35480e9734bb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:23.155662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b8fd8-0fb9-4e6a-8501-35480e9734bb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:23.155662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5b8fd8-0fb9-4e6a-8501-35480e9734bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:23.163942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:23.168027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b8fd8-0fb9-4e6a-8501-35480e9734bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:23.169790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5b8fd8-0fb9-4e6a-8501-35480e9734bb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-9b5b8fd8-0fb9-4e6a-8501-35480e9734bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:23.189768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:23.191281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:23.192153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:23.192153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:23.192153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:23.192153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:23.194363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 297/619] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:23.201697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b8fd8-0fb9-4e6a-8501-35480e9734bb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:23.340269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be8f71-c60e-4a2f-9292-e89fe25bd829 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:23.375923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5b8fd8-0fb9-4e6a-8501-35480e9734bb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:23.405264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58d00-9678-4e49-9d62-259e026acc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:23.406198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58d00-9678-4e49-9d62-259e026acc28 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:23.406481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58d00-9678-4e49-9d62-259e026acc28 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:23.408067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b58d00-9678-4e49-9d62-259e026acc28 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:23.409072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58d00-9678-4e49-9d62-259e026acc28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:23.409383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58d00-9678-4e49-9d62-259e026acc28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:23.411194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b58d00-9678-4e49-9d62-259e026acc28 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:23.447081 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34f84-1233-4d28-ac9a-7df3a7d227c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:23.447745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34f84-1233-4d28-ac9a-7df3a7d227c3 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:23.448078 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34f84-1233-4d28-ac9a-7df3a7d227c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:23.448348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34f84-1233-4d28-ac9a-7df3a7d227c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:23.449140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f34f84-1233-4d28-ac9a-7df3a7d227c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:23.449443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f34f84-1233-4d28-ac9a-7df3a7d227c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:23.450852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f34f84-1233-4d28-ac9a-7df3a7d227c3 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:23.452207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 323/620] 10.222.0.79 () {56 vars in 1133 bytes} [Wed May 25 14:29:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:23.453093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58d00-9678-4e49-9d62-259e026acc28 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:23.479165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 298/621] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:23.487997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34f84-1233-4d28-ac9a-7df3a7d227c3 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:23.584652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:23.586493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:23.595981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b58d00-9678-4e49-9d62-259e026acc28 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:23.644340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cc0bc-ad0f-4f0e-916b-c6374d9d56a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:23.644991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc0bc-ad0f-4f0e-916b-c6374d9d56a5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:23.645266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc0bc-ad0f-4f0e-916b-c6374d9d56a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:23.645536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc0bc-ad0f-4f0e-916b-c6374d9d56a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:23.684979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34f84-1233-4d28-ac9a-7df3a7d227c3 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:23.735041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fe607-2713-41ec-b2ad-ea3d932f4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:23.735833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fe607-2713-41ec-b2ad-ea3d932f4399 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:23.736110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fe607-2713-41ec-b2ad-ea3d932f4399 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:23.736383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043fe607-2713-41ec-b2ad-ea3d932f4399 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:23.751266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fe607-2713-41ec-b2ad-ea3d932f4399 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:23.753270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043fe607-2713-41ec-b2ad-ea3d932f4399 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-043fe607-2713-41ec-b2ad-ea3d932f4399 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:23.777701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:23.778757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:23.779686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:23.779686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:23.779686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:23.779686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:23.779686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:23.779686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:23.779686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:23.779686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:23.779686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:23.779686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:23.782879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 299/622] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:23.787963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cc0bc-ad0f-4f0e-916b-c6374d9d56a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:23.790307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cc0bc-ad0f-4f0e-916b-c6374d9d56a5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:23.790470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fe607-2713-41ec-b2ad-ea3d932f4399 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:23.894736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:23.957510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 324/623] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:23.966105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cc0bc-ad0f-4f0e-916b-c6374d9d56a5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:23.970110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:23.977172 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043fe607-2713-41ec-b2ad-ea3d932f4399 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.025929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1ebf7-887c-46af-8816-fdf9657a7c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.026785 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ebf7-887c-46af-8816-fdf9657a7c0f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.027062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ebf7-887c-46af-8816-fdf9657a7c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.027684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1ebf7-887c-46af-8816-fdf9657a7c0f None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.028544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ebf7-887c-46af-8816-fdf9657a7c0f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:24.029171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ebf7-887c-46af-8816-fdf9657a7c0f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.031882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1ebf7-887c-46af-8816-fdf9657a7c0f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.057120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 300/624] 10.222.0.79 () {56 vars in 1135 bytes} [Wed May 25 14:29:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:24.058542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9bb1-472a-42dd-b0d9-3cc7559879a7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.058826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9bb1-472a-42dd-b0d9-3cc7559879a7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.059097 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef9bb1-472a-42dd-b0d9-3cc7559879a7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.060571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 301/625] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:24.061994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef9bb1-472a-42dd-b0d9-3cc7559879a7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.108957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cc0bc-ad0f-4f0e-916b-c6374d9d56a5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.153572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bb49d-6da7-46da-b77d-b4a590adf75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.154719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb49d-6da7-46da-b77d-b4a590adf75b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.155051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb49d-6da7-46da-b77d-b4a590adf75b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.155328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bb49d-6da7-46da-b77d-b4a590adf75b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.168494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bb49d-6da7-46da-b77d-b4a590adf75b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.170448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91bb49d-6da7-46da-b77d-b4a590adf75b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.173884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef9bb1-472a-42dd-b0d9-3cc7559879a7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c91bb49d-6da7-46da-b77d-b4a590adf75b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:24.193157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:24.194380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:24.196032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:24.196032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:24.196032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:24.196032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:24.196032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 325/626] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:24.196375 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9d01-9420-404b-b86b-11d280d98586 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.200807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9d01-9420-404b-b86b-11d280d98586 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.200807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d9d01-9420-404b-b86b-11d280d98586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.216133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a44e4-b0fe-47dd-9b05-81f7de2496bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.217060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a44e4-b0fe-47dd-9b05-81f7de2496bd None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.217397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a44e4-b0fe-47dd-9b05-81f7de2496bd None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.217736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a44e4-b0fe-47dd-9b05-81f7de2496bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.222228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-597d9d01-9420-404b-b86b-11d280d98586 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:24.223632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-597d9d01-9420-404b-b86b-11d280d98586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:24.229959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a44e4-b0fe-47dd-9b05-81f7de2496bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.231569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a44e4-b0fe-47dd-9b05-81f7de2496bd None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.244622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-c72a44e4-b0fe-47dd-9b05-81f7de2496bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:24.254175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:24.255141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:24.255990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:24.255990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:24.255990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:24.255990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:24.255990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 302/627] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:24.257103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a44e4-b0fe-47dd-9b05-81f7de2496bd None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.269385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:24.317738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 326/628] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:24.318679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d9d01-9420-404b-b86b-11d280d98586 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.383031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a44e4-b0fe-47dd-9b05-81f7de2496bd None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.424318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2b695-2eb9-487e-b1ce-20381eae31ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.425162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2b695-2eb9-487e-b1ce-20381eae31ff None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.425507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2b695-2eb9-487e-b1ce-20381eae31ff None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.425874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2b695-2eb9-487e-b1ce-20381eae31ff None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.426705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2b695-2eb9-487e-b1ce-20381eae31ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:24.427080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2b695-2eb9-487e-b1ce-20381eae31ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.428585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2b695-2eb9-487e-b1ce-20381eae31ff None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.442563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 303/629] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:24.443703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2b695-2eb9-487e-b1ce-20381eae31ff None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.452598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d9d01-9420-404b-b86b-11d280d98586 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.490557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a28879-4c76-4ee4-b5e7-5fa9cd7981cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.491240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28879-4c76-4ee4-b5e7-5fa9cd7981cb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.491517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28879-4c76-4ee4-b5e7-5fa9cd7981cb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.491786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28879-4c76-4ee4-b5e7-5fa9cd7981cb None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.492526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a28879-4c76-4ee4-b5e7-5fa9cd7981cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:24.492831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a28879-4c76-4ee4-b5e7-5fa9cd7981cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.494325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a28879-4c76-4ee4-b5e7-5fa9cd7981cb None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.512977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 327/630] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:24.514000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a28879-4c76-4ee4-b5e7-5fa9cd7981cb None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.522910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:24.529995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:24.561484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2b695-2eb9-487e-b1ce-20381eae31ff None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.600874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b50e2-8abb-4774-98a8-eeb2e70cb1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.601966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b50e2-8abb-4774-98a8-eeb2e70cb1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.602282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b50e2-8abb-4774-98a8-eeb2e70cb1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.602559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b50e2-8abb-4774-98a8-eeb2e70cb1b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.619133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b50e2-8abb-4774-98a8-eeb2e70cb1b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:24.624848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a28879-4c76-4ee4-b5e7-5fa9cd7981cb None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-661b50e2-8abb-4774-98a8-eeb2e70cb1b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:24.626987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:24.629864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 304/631] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:24.632002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b50e2-8abb-4774-98a8-eeb2e70cb1b2 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.671864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b5044-3ec1-4baf-9cc1-7921a1075a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.672662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b5044-3ec1-4baf-9cc1-7921a1075a66 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.672945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b5044-3ec1-4baf-9cc1-7921a1075a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.673278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b5044-3ec1-4baf-9cc1-7921a1075a66 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.680655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b5044-3ec1-4baf-9cc1-7921a1075a66 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.682235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760b5044-3ec1-4baf-9cc1-7921a1075a66 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-760b5044-3ec1-4baf-9cc1-7921a1075a66 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:24.697177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:24.698068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:24.699271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:24.699271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:24.699271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:24.699271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:24.699271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:24.699271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:24.699271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:24.699271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:24.699271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 328/632] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:24.699271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b5044-3ec1-4baf-9cc1-7921a1075a66 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.734339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b50e2-8abb-4774-98a8-eeb2e70cb1b2 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.759207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:24.768783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:24.768918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2011dd1-5e75-4a5b-9e1c-d739064c9bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.769640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011dd1-5e75-4a5b-9e1c-d739064c9bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.769892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011dd1-5e75-4a5b-9e1c-d739064c9bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.770305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2011dd1-5e75-4a5b-9e1c-d739064c9bd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.777078 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2011dd1-5e75-4a5b-9e1c-d739064c9bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.778579 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2011dd1-5e75-4a5b-9e1c-d739064c9bd0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-c2011dd1-5e75-4a5b-9e1c-d739064c9bd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:24.792642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:24.793639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:24.795034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:24.795034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:24.795034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:24.795034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:24.795034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:24.795034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:24.795034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:24.795034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:24.795034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 305/633] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:24.795034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89999ced-bec8-46ed-a892-5b03b3928e46 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.795710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89999ced-bec8-46ed-a892-5b03b3928e46 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.795710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89999ced-bec8-46ed-a892-5b03b3928e46 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.796786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 306/634] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:24.797847 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d742-c8ef-4c54-aff4-f598f77a0620 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.798147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d742-c8ef-4c54-aff4-f598f77a0620 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.798427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c02d742-c8ef-4c54-aff4-f598f77a0620 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.800386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 307/635] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:24.801096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02d742-c8ef-4c54-aff4-f598f77a0620 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.803038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760b5044-3ec1-4baf-9cc1-7921a1075a66 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.837762 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af76263-c1be-43a0-8e64-9f3cec3e4793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.838457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af76263-c1be-43a0-8e64-9f3cec3e4793 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.838742 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af76263-c1be-43a0-8e64-9f3cec3e4793 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.839018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af76263-c1be-43a0-8e64-9f3cec3e4793 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.839762 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af76263-c1be-43a0-8e64-9f3cec3e4793 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:24.840065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af76263-c1be-43a0-8e64-9f3cec3e4793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.843501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af76263-c1be-43a0-8e64-9f3cec3e4793 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.850740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 329/636] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:24.851394 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af76263-c1be-43a0-8e64-9f3cec3e4793 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:24.906205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c02d742-c8ef-4c54-aff4-f598f77a0620 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.939221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b58a3d-b409-4b17-ac9d-b3a509a8dfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.939822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b58a3d-b409-4b17-ac9d-b3a509a8dfc1 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.940154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b58a3d-b409-4b17-ac9d-b3a509a8dfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.940431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b58a3d-b409-4b17-ac9d-b3a509a8dfc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.941215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b58a3d-b409-4b17-ac9d-b3a509a8dfc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:24.941522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b58a3d-b409-4b17-ac9d-b3a509a8dfc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.942979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b58a3d-b409-4b17-ac9d-b3a509a8dfc1 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.954212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 308/637] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:24.954434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af76263-c1be-43a0-8e64-9f3cec3e4793 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:24.955397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3f32-5158-48b9-923c-bb3cea84997b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.955708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3f32-5158-48b9-923c-bb3cea84997b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.955994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d3f32-5158-48b9-923c-bb3cea84997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.972101 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-007d3f32-5158-48b9-923c-bb3cea84997b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:24.973305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-007d3f32-5158-48b9-923c-bb3cea84997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:24.987696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62dcc8e-29ca-4ad8-b2ec-1306368625fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:24.988345 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dcc8e-29ca-4ad8-b2ec-1306368625fc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:24.988626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dcc8e-29ca-4ad8-b2ec-1306368625fc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:24.988900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62dcc8e-29ca-4ad8-b2ec-1306368625fc None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:24.989674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dcc8e-29ca-4ad8-b2ec-1306368625fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:24.989979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dcc8e-29ca-4ad8-b2ec-1306368625fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:24.991451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62dcc8e-29ca-4ad8-b2ec-1306368625fc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:24.992996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:25.005526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 330/638] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:25.006816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68a74-0acd-433e-8cfd-f7f0133affba None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:25.007099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68a74-0acd-433e-8cfd-f7f0133affba None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:25.007372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f68a74-0acd-433e-8cfd-f7f0133affba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:25.020318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:25.023507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-79f68a74-0acd-433e-8cfd-f7f0133affba None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:25.024712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-79f68a74-0acd-433e-8cfd-f7f0133affba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:25.044278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 309/639] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:25.045105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d3f32-5158-48b9-923c-bb3cea84997b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:25.091156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 331/640] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:25.102275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f68a74-0acd-433e-8cfd-f7f0133affba None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:25.143244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d3f32-5158-48b9-923c-bb3cea84997b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:25.176737 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d549d56-ae0f-4a05-b884-4d0914cbd0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:25.177528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d549d56-ae0f-4a05-b884-4d0914cbd0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:25.177809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d549d56-ae0f-4a05-b884-4d0914cbd0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:25.178110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d549d56-ae0f-4a05-b884-4d0914cbd0d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:25.188132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d549d56-ae0f-4a05-b884-4d0914cbd0d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:25.189739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d549d56-ae0f-4a05-b884-4d0914cbd0d5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:25.198858 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f68a74-0acd-433e-8cfd-f7f0133affba None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-6d549d56-ae0f-4a05-b884-4d0914cbd0d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:25.207468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:25.208515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:25.209420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:25.209420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:25.209420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:25.209420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:25.209420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 310/641] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:25.209420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d549d56-ae0f-4a05-b884-4d0914cbd0d5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:25.224857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:25.236178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd1e50-49b8-4cb7-8d0c-4e09cbe7d876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:25.236845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd1e50-49b8-4cb7-8d0c-4e09cbe7d876 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:25.237166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd1e50-49b8-4cb7-8d0c-4e09cbe7d876 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:25.237478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd1e50-49b8-4cb7-8d0c-4e09cbe7d876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:25.238334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd1e50-49b8-4cb7-8d0c-4e09cbe7d876 None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=eb66b6f6b5524f3687411fa83d525acc) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:25.238647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd1e50-49b8-4cb7-8d0c-4e09cbe7d876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:25.239686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:25.240078 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd1e50-49b8-4cb7-8d0c-4e09cbe7d876 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:25.246392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 332/642] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:25 2022] GET /identity/v3/role_assignments?user.id=eb66b6f6b5524f3687411fa83d525acc&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:25.247203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd1e50-49b8-4cb7-8d0c-4e09cbe7d876 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:25.330456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d549d56-ae0f-4a05-b884-4d0914cbd0d5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:25.358649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd1e50-49b8-4cb7-8d0c-4e09cbe7d876 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:25.375642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5bc3c-9c27-43a2-a741-01c8e192cf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:25.377184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5bc3c-9c27-43a2-a741-01c8e192cf5c None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:25.377648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5bc3c-9c27-43a2-a741-01c8e192cf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:25.377951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c5bc3c-9c27-43a2-a741-01c8e192cf5c None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/fa04ddd7a6ce4bbabdfca31721b9c71d/roles/f4c0968e3f8b4988a9f32d8ef25d481b` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:25.396039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d5d93-bd6e-40ba-88ea-4a8fdbdae7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:25.396860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5d93-bd6e-40ba-88ea-4a8fdbdae7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:25.397142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5d93-bd6e-40ba-88ea-4a8fdbdae7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:25.397417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d5d93-bd6e-40ba-88ea-4a8fdbdae7a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:25.397676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5bc3c-9c27-43a2-a741-01c8e192cf5c None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=fa04ddd7a6ce4bbabdfca31721b9c71d, role_id=f4c0968e3f8b4988a9f32d8ef25d481b)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:25.399227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c5bc3c-9c27-43a2-a741-01c8e192cf5c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:25.409885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3d5d93-bd6e-40ba-88ea-4a8fdbdae7a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:25.426112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 311/643] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:29:25 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/fa04ddd7a6ce4bbabdfca31721b9c71d/roles/f4c0968e3f8b4988a9f32d8ef25d481b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:25.426112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5bc3c-9c27-43a2-a741-01c8e192cf5c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-5d3d5d93-bd6e-40ba-88ea-4a8fdbdae7a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:25.426435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:25.427545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 333/644] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:25.428483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d5d93-bd6e-40ba-88ea-4a8fdbdae7a5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:25.488386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:25.557519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:25.559730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3d5d93-bd6e-40ba-88ea-4a8fdbdae7a5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:25.591939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c5bc3c-9c27-43a2-a741-01c8e192cf5c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:25.610813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631d660-fe05-4da3-bbc5-d66dc065ee0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:25.611752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d660-fe05-4da3-bbc5-d66dc065ee0c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:25.612574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d660-fe05-4da3-bbc5-d66dc065ee0c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:25.612846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631d660-fe05-4da3-bbc5-d66dc065ee0c None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:25.614029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631d660-fe05-4da3-bbc5-d66dc065ee0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:25.614443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631d660-fe05-4da3-bbc5-d66dc065ee0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:25.615859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631d660-fe05-4da3-bbc5-d66dc065ee0c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:25.633678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 334/645] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:25.637054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631d660-fe05-4da3-bbc5-d66dc065ee0c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:25.638583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848b238-92dd-40be-b481-8199f325b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:25.639713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b238-92dd-40be-b481-8199f325b735 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:25.640199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b238-92dd-40be-b481-8199f325b735 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:25.640675 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848b238-92dd-40be-b481-8199f325b735 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:25.656430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848b238-92dd-40be-b481-8199f325b735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-e848b238-92dd-40be-b481-8199f325b735 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:25.667672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:25.668600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:25.669553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:25.674138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 312/646] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:25.674138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848b238-92dd-40be-b481-8199f325b735 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:25.774922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631d660-fe05-4da3-bbc5-d66dc065ee0c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:25.786486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848b238-92dd-40be-b481-8199f325b735 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:25.788484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:25.823007 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b3ae0-38fc-4321-938b-db44027e1783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:25.823769 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b3ae0-38fc-4321-938b-db44027e1783 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:25.824225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b3ae0-38fc-4321-938b-db44027e1783 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:25.824508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3b3ae0-38fc-4321-938b-db44027e1783 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:25.825251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b3ae0-38fc-4321-938b-db44027e1783 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:25.825360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa07ec-b28d-438c-be04-76512b8d0c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:25.825546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b3ae0-38fc-4321-938b-db44027e1783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:25.826076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa07ec-b28d-438c-be04-76512b8d0c88 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:25.826389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa07ec-b28d-438c-be04-76512b8d0c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:25.826664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa07ec-b28d-438c-be04-76512b8d0c88 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:25.826960 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3b3ae0-38fc-4321-938b-db44027e1783 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:25.836371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa07ec-b28d-438c-be04-76512b8d0c88 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:25.837836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa07ec-b28d-438c-be04-76512b8d0c88 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:25.844589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 335/647] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:25.844589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b3ae0-38fc-4321-938b-db44027e1783 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:25.850876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-54aa07ec-b28d-438c-be04-76512b8d0c88 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:25.873939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:25.875253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 313/648] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:25.877352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa07ec-b28d-438c-be04-76512b8d0c88 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:25.964453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3b3ae0-38fc-4321-938b-db44027e1783 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:25.995304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa07ec-b28d-438c-be04-76512b8d0c88 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.000806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04d5c4-b82e-4df7-946f-d52794cd54ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.001481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04d5c4-b82e-4df7-946f-d52794cd54ea None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.001763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04d5c4-b82e-4df7-946f-d52794cd54ea None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.002037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04d5c4-b82e-4df7-946f-d52794cd54ea None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.003357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04d5c4-b82e-4df7-946f-d52794cd54ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:26.003664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04d5c4-b82e-4df7-946f-d52794cd54ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.005041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04d5c4-b82e-4df7-946f-d52794cd54ea None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:26.014647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 336/649] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:26.015551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04d5c4-b82e-4df7-946f-d52794cd54ea None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.034514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcde6e-2aa3-4452-a5eb-185c0a329f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.035650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcde6e-2aa3-4452-a5eb-185c0a329f75 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.036178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcde6e-2aa3-4452-a5eb-185c0a329f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.036674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fcde6e-2aa3-4452-a5eb-185c0a329f75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.048387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcde6e-2aa3-4452-a5eb-185c0a329f75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.049883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:26.051239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fcde6e-2aa3-4452-a5eb-185c0a329f75 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-94fcde6e-2aa3-4452-a5eb-185c0a329f75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:26.071321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:26.072220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:26.073069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:26.073069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:26.073069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:26.073069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:26.079785 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 314/650] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:26.081398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcde6e-2aa3-4452-a5eb-185c0a329f75 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.123944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04d5c4-b82e-4df7-946f-d52794cd54ea None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.139954 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:26.162315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c692c-f0c9-46ee-ac2e-5ebb954bc197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.162976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c692c-f0c9-46ee-ac2e-5ebb954bc197 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.163261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c692c-f0c9-46ee-ac2e-5ebb954bc197 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.163540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c692c-f0c9-46ee-ac2e-5ebb954bc197 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.164385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c692c-f0c9-46ee-ac2e-5ebb954bc197 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:26.164694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c692c-f0c9-46ee-ac2e-5ebb954bc197 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.166162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c692c-f0c9-46ee-ac2e-5ebb954bc197 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:26.186132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 337/651] 10.222.0.79 () {56 vars in 1137 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:26.186983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c692c-f0c9-46ee-ac2e-5ebb954bc197 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.196932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fcde6e-2aa3-4452-a5eb-185c0a329f75 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.238306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046db3ad-61f0-457f-9743-2ae4e816cf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.239449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db3ad-61f0-457f-9743-2ae4e816cf9f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.240022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db3ad-61f0-457f-9743-2ae4e816cf9f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.240529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046db3ad-61f0-457f-9743-2ae4e816cf9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.254142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046db3ad-61f0-457f-9743-2ae4e816cf9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.255860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046db3ad-61f0-457f-9743-2ae4e816cf9f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-046db3ad-61f0-457f-9743-2ae4e816cf9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:26.275601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:26.276671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:26.277613 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:26.277613 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:26.277613 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:26.277613 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:26.280452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 315/652] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:26.281654 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046db3ad-61f0-457f-9743-2ae4e816cf9f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.283269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:26.293697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c692c-f0c9-46ee-ac2e-5ebb954bc197 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.331211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79293f02-0029-456b-9a32-5872d15c794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.331834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79293f02-0029-456b-9a32-5872d15c794c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.332120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79293f02-0029-456b-9a32-5872d15c794c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.332391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79293f02-0029-456b-9a32-5872d15c794c None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.333106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79293f02-0029-456b-9a32-5872d15c794c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:26.333409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79293f02-0029-456b-9a32-5872d15c794c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.334951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79293f02-0029-456b-9a32-5872d15c794c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:26.348117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 338/653] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:26.348117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79293f02-0029-456b-9a32-5872d15c794c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.404067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046db3ad-61f0-457f-9743-2ae4e816cf9f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.406027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:26.441084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bfde5-e3a5-44ad-8a9d-3840adca06f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.442075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bfde5-e3a5-44ad-8a9d-3840adca06f8 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.442671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bfde5-e3a5-44ad-8a9d-3840adca06f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.443152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bfde5-e3a5-44ad-8a9d-3840adca06f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.454844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79293f02-0029-456b-9a32-5872d15c794c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.493363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a0007-1cde-43ff-8074-ceca249ffd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.494171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a0007-1cde-43ff-8074-ceca249ffd3d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.494357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a0007-1cde-43ff-8074-ceca249ffd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.494777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a0007-1cde-43ff-8074-ceca249ffd3d None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.495441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a0007-1cde-43ff-8074-ceca249ffd3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:26.495750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a0007-1cde-43ff-8074-ceca249ffd3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.497325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a0007-1cde-43ff-8074-ceca249ffd3d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:26.514499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 339/654] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:26.514499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a0007-1cde-43ff-8074-ceca249ffd3d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.524200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:26.525917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bfde5-e3a5-44ad-8a9d-3840adca06f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.527706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bfde5-e3a5-44ad-8a9d-3840adca06f8 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:26.621452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a0007-1cde-43ff-8074-ceca249ffd3d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.642789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 316/655] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:26.644033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bfde5-e3a5-44ad-8a9d-3840adca06f8 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.648210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:26.662065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e7378-6b01-4016-a9a3-9915a5211337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.662879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e7378-6b01-4016-a9a3-9915a5211337 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.663161 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e7378-6b01-4016-a9a3-9915a5211337 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.663433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e7378-6b01-4016-a9a3-9915a5211337 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.671358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e7378-6b01-4016-a9a3-9915a5211337 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.672975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e7378-6b01-4016-a9a3-9915a5211337 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-4a3e7378-6b01-4016-a9a3-9915a5211337 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:26.691557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:26.692510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:26.693412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 340/656] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:26.693989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e7378-6b01-4016-a9a3-9915a5211337 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.755503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bfde5-e3a5-44ad-8a9d-3840adca06f8 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.767926 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:26.794770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f08ae-95b9-4ebe-b14e-5bfa264806c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.796004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f08ae-95b9-4ebe-b14e-5bfa264806c7 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.796508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f08ae-95b9-4ebe-b14e-5bfa264806c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.797014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f08ae-95b9-4ebe-b14e-5bfa264806c7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.801943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e7378-6b01-4016-a9a3-9915a5211337 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.805732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f08ae-95b9-4ebe-b14e-5bfa264806c7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.807411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f08ae-95b9-4ebe-b14e-5bfa264806c7 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-357f08ae-95b9-4ebe-b14e-5bfa264806c7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:26.823632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:26.824543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:26.825446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:26.825446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:26.825446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:26.825446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:26.825446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:26.825446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:26.825446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:26.825446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:26.825446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 14:29:26.825446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:26.832527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 317/657] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:26.833573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f08ae-95b9-4ebe-b14e-5bfa264806c7 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.837763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ac245-2936-49d9-bce3-bd7c8c030e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.838138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ac245-2936-49d9-bce3-bd7c8c030e72 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.838428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ac245-2936-49d9-bce3-bd7c8c030e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.838701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908ac245-2936-49d9-bce3-bd7c8c030e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.849674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ac245-2936-49d9-bce3-bd7c8c030e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.851736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908ac245-2936-49d9-bce3-bd7c8c030e72 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-908ac245-2936-49d9-bce3-bd7c8c030e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:26.873569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:26.874634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:26.875697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:26.875697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:26.875697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:26.875697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:26.878457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 341/658] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:26.879395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ac245-2936-49d9-bce3-bd7c8c030e72 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:26.914592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:26.955475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f08ae-95b9-4ebe-b14e-5bfa264806c7 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.984274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908ac245-2936-49d9-bce3-bd7c8c030e72 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:26.991558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f466cc4-0f62-408e-b1e7-cb660f46bfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:26.992349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f466cc4-0f62-408e-b1e7-cb660f46bfa0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:26.992801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f466cc4-0f62-408e-b1e7-cb660f46bfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:26.993163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f466cc4-0f62-408e-b1e7-cb660f46bfa0 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:26.994258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f466cc4-0f62-408e-b1e7-cb660f46bfa0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:26.994585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f466cc4-0f62-408e-b1e7-cb660f46bfa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:26.996093 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f466cc4-0f62-408e-b1e7-cb660f46bfa0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.011020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.018313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 318/659] 10.222.0.79 () {56 vars in 1137 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:27.019425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f466cc4-0f62-408e-b1e7-cb660f46bfa0 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.024173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd11cbd-dbae-447d-9a6b-0d795806876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.025073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd11cbd-dbae-447d-9a6b-0d795806876f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.025535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd11cbd-dbae-447d-9a6b-0d795806876f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.025987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd11cbd-dbae-447d-9a6b-0d795806876f None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.027044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd11cbd-dbae-447d-9a6b-0d795806876f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:27.027556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd11cbd-dbae-447d-9a6b-0d795806876f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.029175 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd11cbd-dbae-447d-9a6b-0d795806876f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.047254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 342/660] 10.222.0.79 () {56 vars in 1139 bytes} [Wed May 25 14:29:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:27.048380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd11cbd-dbae-447d-9a6b-0d795806876f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.131564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f466cc4-0f62-408e-b1e7-cb660f46bfa0 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.151680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd11cbd-dbae-447d-9a6b-0d795806876f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.156997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.171551 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c54b1-afd6-4466-985c-f25c229cb5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.172041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c54b1-afd6-4466-985c-f25c229cb5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.172333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c54b1-afd6-4466-985c-f25c229cb5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.172612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c54b1-afd6-4466-985c-f25c229cb5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.173337 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c54b1-afd6-4466-985c-f25c229cb5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:27.173646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c54b1-afd6-4466-985c-f25c229cb5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.175092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c54b1-afd6-4466-985c-f25c229cb5a9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.190967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21910a35-7828-4c36-929d-6efb0e7659fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.191996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21910a35-7828-4c36-929d-6efb0e7659fa None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.192820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21910a35-7828-4c36-929d-6efb0e7659fa None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.192927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 319/661] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:27.193407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21910a35-7828-4c36-929d-6efb0e7659fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.193752 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c54b1-afd6-4466-985c-f25c229cb5a9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.244341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.265579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21910a35-7828-4c36-929d-6efb0e7659fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.267592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21910a35-7828-4c36-929d-6efb0e7659fa None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.302064 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c54b1-afd6-4466-985c-f25c229cb5a9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.337353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d01a8d-9ba1-47d8-b68f-352ed89ab65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.338006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01a8d-9ba1-47d8-b68f-352ed89ab65f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.338324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01a8d-9ba1-47d8-b68f-352ed89ab65f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.338603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d01a8d-9ba1-47d8-b68f-352ed89ab65f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.376797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 343/662] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:27.378374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21910a35-7828-4c36-929d-6efb0e7659fa None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.390790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.414856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d01a8d-9ba1-47d8-b68f-352ed89ab65f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.416858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d01a8d-9ba1-47d8-b68f-352ed89ab65f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.467705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.490047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21910a35-7828-4c36-929d-6efb0e7659fa None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.523345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 320/663] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:27.527354 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecff60-00d4-4ae5-a872-a31e461503e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.528530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d01a8d-9ba1-47d8-b68f-352ed89ab65f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.528959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecff60-00d4-4ae5-a872-a31e461503e3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.529444 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecff60-00d4-4ae5-a872-a31e461503e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.529919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ecff60-00d4-4ae5-a872-a31e461503e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.537801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecff60-00d4-4ae5-a872-a31e461503e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.539561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ecff60-00d4-4ae5-a872-a31e461503e3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b8ecff60-00d4-4ae5-a872-a31e461503e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:27.555207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:27.556093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:27.556973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:27.556973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:27.556973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:27.556973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:27.556973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:27.556973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:27.556973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:27.556973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:27.559457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 344/664] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:27.560542 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecff60-00d4-4ae5-a872-a31e461503e3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.624716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.644562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d01a8d-9ba1-47d8-b68f-352ed89ab65f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.676191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ecff60-00d4-4ae5-a872-a31e461503e3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.681046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e59649-54f1-4df6-8ed4-11ad62260c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.681855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59649-54f1-4df6-8ed4-11ad62260c65 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.682167 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59649-54f1-4df6-8ed4-11ad62260c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.682447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e59649-54f1-4df6-8ed4-11ad62260c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.692923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e59649-54f1-4df6-8ed4-11ad62260c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.694492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e59649-54f1-4df6-8ed4-11ad62260c65 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.711033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37e04b-a439-4b23-a9c2-07b92de440a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.711827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e04b-a439-4b23-a9c2-07b92de440a7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.712111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e04b-a439-4b23-a9c2-07b92de440a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.712385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37e04b-a439-4b23-a9c2-07b92de440a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-e8e59649-54f1-4df6-8ed4-11ad62260c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:27.712684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:27.713507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:27.714833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:27.714833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:27.714833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:27.714833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:27.714833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 321/665] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:27.715113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e59649-54f1-4df6-8ed4-11ad62260c65 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.728129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.730495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e04b-a439-4b23-a9c2-07b92de440a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.732396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee37e04b-a439-4b23-a9c2-07b92de440a7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-ee37e04b-a439-4b23-a9c2-07b92de440a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:27.750724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:27.751681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:27.752577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:27.752577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:27.752577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:27.752577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:27.752577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 345/666] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:27.753946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e504015-3792-4cb4-9265-aa3f2d9f7f96 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.753946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e504015-3792-4cb4-9265-aa3f2d9f7f96 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.753946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e504015-3792-4cb4-9265-aa3f2d9f7f96 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.758995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 346/667] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:27.758995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e504015-3792-4cb4-9265-aa3f2d9f7f96 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.821488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e59649-54f1-4df6-8ed4-11ad62260c65 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.858382 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952143c-860e-42f5-8b73-3f85f0d92790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.859076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952143c-860e-42f5-8b73-3f85f0d92790 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.859355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952143c-860e-42f5-8b73-3f85f0d92790 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.859625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952143c-860e-42f5-8b73-3f85f0d92790 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.860403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952143c-860e-42f5-8b73-3f85f0d92790 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:27.860578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e504015-3792-4cb4-9265-aa3f2d9f7f96 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.860734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952143c-860e-42f5-8b73-3f85f0d92790 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.862210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952143c-860e-42f5-8b73-3f85f0d92790 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.863785 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.874552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 322/668] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:27.875339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952143c-860e-42f5-8b73-3f85f0d92790 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:27.895569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5da8ac-7f28-47a7-9885-4f193218daf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:27.896160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5da8ac-7f28-47a7-9885-4f193218daf2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.896446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5da8ac-7f28-47a7-9885-4f193218daf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.896720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5da8ac-7f28-47a7-9885-4f193218daf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.897459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5da8ac-7f28-47a7-9885-4f193218daf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:27.897740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5da8ac-7f28-47a7-9885-4f193218daf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:27.899139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5da8ac-7f28-47a7-9885-4f193218daf2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:27.911341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 347/669] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:27.912507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0ccd8-8165-4412-b701-253b911cabde None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.912794 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0ccd8-8165-4412-b701-253b911cabde None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.913065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e0ccd8-8165-4412-b701-253b911cabde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:27.928364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-71e0ccd8-8165-4412-b701-253b911cabde None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:27.929535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-71e0ccd8-8165-4412-b701-253b911cabde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:27.975718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:27.980555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952143c-860e-42f5-8b73-3f85f0d92790 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:27.995727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 348/670] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:27.997080 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b6eb3-9305-4b38-8885-1947c169393b None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:27.997365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b6eb3-9305-4b38-8885-1947c169393b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:27.997636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b6eb3-9305-4b38-8885-1947c169393b None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.003838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 349/671] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:28.004589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b6eb3-9305-4b38-8885-1947c169393b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:28.013844 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73fe24-c058-4e57-af59-92a583f59bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:28.014542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73fe24-c058-4e57-af59-92a583f59bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.014829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73fe24-c058-4e57-af59-92a583f59bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.015107 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa73fe24-c058-4e57-af59-92a583f59bd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.015827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73fe24-c058-4e57-af59-92a583f59bd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:28.016134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73fe24-c058-4e57-af59-92a583f59bd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:28.017500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa73fe24-c058-4e57-af59-92a583f59bd0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:28.029424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 323/672] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:28.030235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73fe24-c058-4e57-af59-92a583f59bd0 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:28.084221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:28.119619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b6eb3-9305-4b38-8885-1947c169393b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:28.128105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa73fe24-c058-4e57-af59-92a583f59bd0 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:28.154614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fc581-9137-4008-afb1-6831971db49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:28.155257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fc581-9137-4008-afb1-6831971db49d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.155537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fc581-9137-4008-afb1-6831971db49d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.155809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fc581-9137-4008-afb1-6831971db49d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.156625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fc581-9137-4008-afb1-6831971db49d None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=0edbf66359f1426999f4c28a83f2bdca) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:28.156927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fc581-9137-4008-afb1-6831971db49d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:28.158381 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fc581-9137-4008-afb1-6831971db49d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:28.161344 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c342-0bb8-4332-a6f4-a285b2975524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:28.162166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c342-0bb8-4332-a6f4-a285b2975524 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.162449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c342-0bb8-4332-a6f4-a285b2975524 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.162728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2c342-0bb8-4332-a6f4-a285b2975524 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.164653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 350/673] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/role_assignments?user.id=0edbf66359f1426999f4c28a83f2bdca&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:28.165862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915d9b1-c81a-4606-b24d-09d005728318 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.166170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915d9b1-c81a-4606-b24d-09d005728318 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.166447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b915d9b1-c81a-4606-b24d-09d005728318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.179516 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c342-0bb8-4332-a6f4-a285b2975524 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:28.181025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2c342-0bb8-4332-a6f4-a285b2975524 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:28.184363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b915d9b1-c81a-4606-b24d-09d005728318 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:28.185972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b915d9b1-c81a-4606-b24d-09d005728318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-72b2c342-0bb8-4332-a6f4-a285b2975524 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:28.197532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:28.198554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:28.199432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:28.199432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:28.199432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:28.199432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:28.199432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:28.199432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:28.199432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:28.199432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:28.199432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 324/674] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:28.199907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c342-0bb8-4332-a6f4-a285b2975524 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:28.317228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2c342-0bb8-4332-a6f4-a285b2975524 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:28.334896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:28.360044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c06c5-4ec2-44e9-8a07-ab6a3b6d519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:28.360878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c06c5-4ec2-44e9-8a07-ab6a3b6d519f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.361160 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c06c5-4ec2-44e9-8a07-ab6a3b6d519f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.361438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c06c5-4ec2-44e9-8a07-ab6a3b6d519f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.374741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c06c5-4ec2-44e9-8a07-ab6a3b6d519f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-966c06c5-4ec2-44e9-8a07-ab6a3b6d519f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:28.382873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:28.383861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:28.384688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 325/675] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:28.385621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c06c5-4ec2-44e9-8a07-ab6a3b6d519f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:28.398170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:28.428646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 351/676] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:28.430975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915d9b1-c81a-4606-b24d-09d005728318 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:28.504028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c06c5-4ec2-44e9-8a07-ab6a3b6d519f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:28.540543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b915d9b1-c81a-4606-b24d-09d005728318 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:28.542631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e602243-7a2f-4883-839c-11f2e0a56fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:28.543434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e602243-7a2f-4883-839c-11f2e0a56fda None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.543722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e602243-7a2f-4883-839c-11f2e0a56fda None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.544002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e602243-7a2f-4883-839c-11f2e0a56fda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.551506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e602243-7a2f-4883-839c-11f2e0a56fda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:28.552958 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e602243-7a2f-4883-839c-11f2e0a56fda None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-1e602243-7a2f-4883-839c-11f2e0a56fda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:28.567538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:28.568417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:28.569280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:28.569280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:28.569280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:28.569280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:28.569280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:28.569280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:28.569280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:28.569280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:28.569280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 326/677] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:28.569748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e602243-7a2f-4883-839c-11f2e0a56fda None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:28.582910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbab828-b5ba-4b49-982c-21434210cac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:28.583856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab828-b5ba-4b49-982c-21434210cac4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.584222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab828-b5ba-4b49-982c-21434210cac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.584501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbab828-b5ba-4b49-982c-21434210cac4 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.585294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbab828-b5ba-4b49-982c-21434210cac4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:28.585681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbab828-b5ba-4b49-982c-21434210cac4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:28.587075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbab828-b5ba-4b49-982c-21434210cac4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:28.599518 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 352/678] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:28.600164 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbab828-b5ba-4b49-982c-21434210cac4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:28.615063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:28.637771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:28.684033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e602243-7a2f-4883-839c-11f2e0a56fda None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:28.707870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbab828-b5ba-4b49-982c-21434210cac4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:28.720695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5daca-6825-45ef-9b29-3d1692f0de00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:28.721970 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5daca-6825-45ef-9b29-3d1692f0de00 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.722279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5daca-6825-45ef-9b29-3d1692f0de00 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.722556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a5daca-6825-45ef-9b29-3d1692f0de00 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.723317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5daca-6825-45ef-9b29-3d1692f0de00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:28.723621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5daca-6825-45ef-9b29-3d1692f0de00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:28.724977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a5daca-6825-45ef-9b29-3d1692f0de00 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:28.733616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 327/679] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:28.734518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5daca-6825-45ef-9b29-3d1692f0de00 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:28.745753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843cfc5-544c-4aa9-b4c5-df975ed75be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:28.747000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843cfc5-544c-4aa9-b4c5-df975ed75be3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.747284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843cfc5-544c-4aa9-b4c5-df975ed75be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.747556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843cfc5-544c-4aa9-b4c5-df975ed75be3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.760719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843cfc5-544c-4aa9-b4c5-df975ed75be3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-5843cfc5-544c-4aa9-b4c5-df975ed75be3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:28.769036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:28.769955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:28.770847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 353/680] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:28.771523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843cfc5-544c-4aa9-b4c5-df975ed75be3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:28.847169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:28.853896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a5daca-6825-45ef-9b29-3d1692f0de00 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:28.879480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:28.886839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843cfc5-544c-4aa9-b4c5-df975ed75be3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:28.891525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b441ce-b33c-4a7d-ba9b-9cacf43d617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:28.892183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b441ce-b33c-4a7d-ba9b-9cacf43d617c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.892464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b441ce-b33c-4a7d-ba9b-9cacf43d617c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.892735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b441ce-b33c-4a7d-ba9b-9cacf43d617c None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.893576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b441ce-b33c-4a7d-ba9b-9cacf43d617c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:28.893880 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b441ce-b33c-4a7d-ba9b-9cacf43d617c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:28.895375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b441ce-b33c-4a7d-ba9b-9cacf43d617c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:28.907975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 328/681] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:28.909323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b441ce-b33c-4a7d-ba9b-9cacf43d617c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:28.928817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f87f5-016f-4aa4-8244-bfaff6c0e3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:28.929613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f87f5-016f-4aa4-8244-bfaff6c0e3ec None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:28.929957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f87f5-016f-4aa4-8244-bfaff6c0e3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:28.930341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f87f5-016f-4aa4-8244-bfaff6c0e3ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:28.931178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f87f5-016f-4aa4-8244-bfaff6c0e3ec None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=eacbb2c50c2c464db93b6cff7a10f7c0) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:28.931494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f87f5-016f-4aa4-8244-bfaff6c0e3ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:28.932928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79f87f5-016f-4aa4-8244-bfaff6c0e3ec None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:28.950198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 354/682] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/role_assignments?user.id=eacbb2c50c2c464db93b6cff7a10f7c0&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:28.950198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f87f5-016f-4aa4-8244-bfaff6c0e3ec None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:29.034305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b441ce-b33c-4a7d-ba9b-9cacf43d617c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:29.073433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d83b-4322-47df-92c3-885c12c7af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:29.074581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d83b-4322-47df-92c3-885c12c7af71 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:29.074870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d83b-4322-47df-92c3-885c12c7af71 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:29.075148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429d83b-4322-47df-92c3-885c12c7af71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:29.081677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f87f5-016f-4aa4-8244-bfaff6c0e3ec None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:29.087452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429d83b-4322-47df-92c3-885c12c7af71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:29.089001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429d83b-4322-47df-92c3-885c12c7af71 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-0429d83b-4322-47df-92c3-885c12c7af71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:29.109282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:29.110341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:29.112247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:29.112247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:29.112247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:29.112247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:29.112247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 329/683] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:29.112525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d83b-4322-47df-92c3-885c12c7af71 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:29.125055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:29.132109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502c189-8c16-4e0e-9aba-8f3217e9ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:29.132801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c189-8c16-4e0e-9aba-8f3217e9ed0e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:29.133644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c189-8c16-4e0e-9aba-8f3217e9ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:29.133937 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5502c189-8c16-4e0e-9aba-8f3217e9ed0e None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:29.135369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502c189-8c16-4e0e-9aba-8f3217e9ed0e None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:29.135730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502c189-8c16-4e0e-9aba-8f3217e9ed0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:29.137928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5502c189-8c16-4e0e-9aba-8f3217e9ed0e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:29.150657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 355/684] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:29.151600 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502c189-8c16-4e0e-9aba-8f3217e9ed0e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:29.186873 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:29.236322 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429d83b-4322-47df-92c3-885c12c7af71 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:29.271748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0b903-4053-4672-b5ed-4322a12291f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:29.272563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0b903-4053-4672-b5ed-4322a12291f9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:29.272955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0b903-4053-4672-b5ed-4322a12291f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:29.273338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da0b903-4053-4672-b5ed-4322a12291f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:29.274311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0b903-4053-4672-b5ed-4322a12291f9 None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=e4270ab375e04196ad17f121f4175915) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:29.274689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5502c189-8c16-4e0e-9aba-8f3217e9ed0e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:29.274803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0b903-4053-4672-b5ed-4322a12291f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:29.276392 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da0b903-4053-4672-b5ed-4322a12291f9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:29.290106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 330/685] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:29 2022] GET /identity/v3/role_assignments?user.id=e4270ab375e04196ad17f121f4175915&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:29.290106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0b903-4053-4672-b5ed-4322a12291f9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:29.336689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b260157-4de1-447e-b684-64f12013b8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:29.337421 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b260157-4de1-447e-b684-64f12013b8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:29.337662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b260157-4de1-447e-b684-64f12013b8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:29.337939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b260157-4de1-447e-b684-64f12013b8d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:29.342111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b260157-4de1-447e-b684-64f12013b8d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:29.342111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b260157-4de1-447e-b684-64f12013b8d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:29.342111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b260157-4de1-447e-b684-64f12013b8d6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:29.353509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 356/686] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:29.358607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b260157-4de1-447e-b684-64f12013b8d6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:29.403259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:29.436419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da0b903-4053-4672-b5ed-4322a12291f9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:29.491823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0460-6395-4365-9dbc-963bc46ca11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:29.493070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0460-6395-4365-9dbc-963bc46ca11c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:29.493633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:29.494780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0460-6395-4365-9dbc-963bc46ca11c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:29.495428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d0460-6395-4365-9dbc-963bc46ca11c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:29.518182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d0460-6395-4365-9dbc-963bc46ca11c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:29.521049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d0460-6395-4365-9dbc-963bc46ca11c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:29.537899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b260157-4de1-447e-b684-64f12013b8d6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-566d0460-6395-4365-9dbc-963bc46ca11c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:29.559922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:29.561142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:29.562014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:29.562014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:29.562014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:29.562014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:29.562014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 331/687] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:29.567806 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0460-6395-4365-9dbc-963bc46ca11c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:29.612014 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8e38d-fd35-49e0-9a36-3b5a9ec7c482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:29.612893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e38d-fd35-49e0-9a36-3b5a9ec7c482 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:29.613762 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e38d-fd35-49e0-9a36-3b5a9ec7c482 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:29.613762 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8e38d-fd35-49e0-9a36-3b5a9ec7c482 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:29.622000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8e38d-fd35-49e0-9a36-3b5a9ec7c482 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:29.623706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d8e38d-fd35-49e0-9a36-3b5a9ec7c482 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f8d8e38d-fd35-49e0-9a36-3b5a9ec7c482 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:29.640388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:29.641548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:29.642720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:29.642720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:29.642720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:29.642720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:29.642720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:29.642720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:29.642720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:29.642720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:29.642720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:29.642720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:29.645236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 357/688] 10.222.0.79 () {56 vars in 1093 bytes} [Wed May 25 14:29:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:29.650250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8e38d-fd35-49e0-9a36-3b5a9ec7c482 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:29.725015 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d0460-6395-4365-9dbc-963bc46ca11c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:29.755203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8e38d-fd35-49e0-9a36-3b5a9ec7c482 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:29.761642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a646bc-63eb-47bd-9a14-e5afbc153a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:29.762365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a646bc-63eb-47bd-9a14-e5afbc153a61 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:29.762653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a646bc-63eb-47bd-9a14-e5afbc153a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:29.762939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a646bc-63eb-47bd-9a14-e5afbc153a61 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:29.763666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a646bc-63eb-47bd-9a14-e5afbc153a61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:29.764087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a646bc-63eb-47bd-9a14-e5afbc153a61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:29.765485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a646bc-63eb-47bd-9a14-e5afbc153a61 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:29.778506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:29.782373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 332/689] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:29.784237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a646bc-63eb-47bd-9a14-e5afbc153a61 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:29.794979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee2110-8541-4a2c-a5a6-20b496e195d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:29.795810 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2110-8541-4a2c-a5a6-20b496e195d4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:29.796205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2110-8541-4a2c-a5a6-20b496e195d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:29.796652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee2110-8541-4a2c-a5a6-20b496e195d4 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:29.797593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee2110-8541-4a2c-a5a6-20b496e195d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:29.798037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee2110-8541-4a2c-a5a6-20b496e195d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:29.799793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee2110-8541-4a2c-a5a6-20b496e195d4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:29.814878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:29.820142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 358/690] 10.222.0.79 () {56 vars in 1133 bytes} [Wed May 25 14:29:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:29.824964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee2110-8541-4a2c-a5a6-20b496e195d4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:29.987464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee2110-8541-4a2c-a5a6-20b496e195d4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.025904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a646bc-63eb-47bd-9a14-e5afbc153a61 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.035107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed093c7-3e45-4cb4-9868-03d9c759dfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:30.035807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed093c7-3e45-4cb4-9868-03d9c759dfca None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.036089 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed093c7-3e45-4cb4-9868-03d9c759dfca None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.036358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed093c7-3e45-4cb4-9868-03d9c759dfca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.082196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef854fc4-c015-4abf-ae07-8e1daa0cc780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:30.082998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854fc4-c015-4abf-ae07-8e1daa0cc780 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.083450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854fc4-c015-4abf-ae07-8e1daa0cc780 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.083725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef854fc4-c015-4abf-ae07-8e1daa0cc780 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.092525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef854fc4-c015-4abf-ae07-8e1daa0cc780 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:30.094543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef854fc4-c015-4abf-ae07-8e1daa0cc780 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-ef854fc4-c015-4abf-ae07-8e1daa0cc780 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:30.110562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:30.112437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:30.113710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 333/691] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:30.119930 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef854fc4-c015-4abf-ae07-8e1daa0cc780 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:30.182481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:30.186342 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed093c7-3e45-4cb4-9868-03d9c759dfca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:30.188557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed093c7-3e45-4cb4-9868-03d9c759dfca None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:30.218450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:30.281789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef854fc4-c015-4abf-ae07-8e1daa0cc780 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.365501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 359/692] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 14:29:30.371176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed093c7-3e45-4cb4-9868-03d9c759dfca None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:30.379318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b322f-75c7-41f8-804e-61df1d10b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:30.380005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b322f-75c7-41f8-804e-61df1d10b809 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.380291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b322f-75c7-41f8-804e-61df1d10b809 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.380568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b322f-75c7-41f8-804e-61df1d10b809 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.381417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b322f-75c7-41f8-804e-61df1d10b809 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:30.381730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b322f-75c7-41f8-804e-61df1d10b809 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:30.383201 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116b322f-75c7-41f8-804e-61df1d10b809 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:30.421870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 334/693] 10.222.0.79 () {56 vars in 1135 bytes} [Wed May 25 14:29:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:30.427240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b322f-75c7-41f8-804e-61df1d10b809 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:30.480110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:30.484438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed093c7-3e45-4cb4-9868-03d9c759dfca None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.523597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea79ae-3893-40f6-8058-5baf708cd3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:30.524741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea79ae-3893-40f6-8058-5baf708cd3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.525327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea79ae-3893-40f6-8058-5baf708cd3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.525787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea79ae-3893-40f6-8058-5baf708cd3a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.546586 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea79ae-3893-40f6-8058-5baf708cd3a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:30.549012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea79ae-3893-40f6-8058-5baf708cd3a2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-73ea79ae-3893-40f6-8058-5baf708cd3a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:30.580084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:30.581538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:30.582490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:30.582490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:30.582490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:30.582490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:30.592611 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 360/694] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:30.602942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea79ae-3893-40f6-8058-5baf708cd3a2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:30.651339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b322f-75c7-41f8-804e-61df1d10b809 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.653125 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:30.697867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95628ec-9652-4bed-aeb6-f379ffa48789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:30.698820 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95628ec-9652-4bed-aeb6-f379ffa48789 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.699269 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95628ec-9652-4bed-aeb6-f379ffa48789 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.700283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95628ec-9652-4bed-aeb6-f379ffa48789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.747767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea79ae-3893-40f6-8058-5baf708cd3a2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.789299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5be96-9307-4158-8568-835d35926ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:30.790537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5be96-9307-4158-8568-835d35926ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.791053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5be96-9307-4158-8568-835d35926ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.791549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5be96-9307-4158-8568-835d35926ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.792475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5be96-9307-4158-8568-835d35926ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:30.793002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5be96-9307-4158-8568-835d35926ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:30.794738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5be96-9307-4158-8568-835d35926ac5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:30.797240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95628ec-9652-4bed-aeb6-f379ffa48789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:30.798663 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95628ec-9652-4bed-aeb6-f379ffa48789 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:30.812907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 361/695] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:30.814772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227580c0-2c6a-492a-a70c-9a5e0ca8b9bf None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.815295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227580c0-2c6a-492a-a70c-9a5e0ca8b9bf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.815834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227580c0-2c6a-492a-a70c-9a5e0ca8b9bf None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.817787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 362/696] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:30.818726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227580c0-2c6a-492a-a70c-9a5e0ca8b9bf None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:30.840195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:30.904058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 335/697] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 14:29:30.905529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43c3c3-a1fb-40f3-862e-e9c43dbea801 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:30.905814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43c3c3-a1fb-40f3-862e-e9c43dbea801 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:30.906105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43c3c3-a1fb-40f3-862e-e9c43dbea801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:30.911757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:30.923767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-be43c3c3-a1fb-40f3-862e-e9c43dbea801 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:30.925017 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-be43c3c3-a1fb-40f3-862e-e9c43dbea801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:30.959524 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227580c0-2c6a-492a-a70c-9a5e0ca8b9bf None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:30.998138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 336/698] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:30.998138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43c3c3-a1fb-40f3-862e-e9c43dbea801 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.005912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e9f5f-f19d-45d4-931e-a9db3293e385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.007055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e9f5f-f19d-45d4-931e-a9db3293e385 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.007697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e9f5f-f19d-45d4-931e-a9db3293e385 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.008192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e9f5f-f19d-45d4-931e-a9db3293e385 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.026784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e9f5f-f19d-45d4-931e-a9db3293e385 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.028678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968e9f5f-f19d-45d4-931e-a9db3293e385 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-968e9f5f-f19d-45d4-931e-a9db3293e385 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:31.051026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:31.051925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:31.052796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:31.052796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:31.052796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:31.052796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:31.052796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:31.052796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:31.052796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:31.052796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:31.060557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 363/699] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:31.061737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e9f5f-f19d-45d4-931e-a9db3293e385 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.096930 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43c3c3-a1fb-40f3-862e-e9c43dbea801 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:31.127286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:31.132519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90586283-4d89-44c8-b59e-8490adb60853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.133764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90586283-4d89-44c8-b59e-8490adb60853 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.134115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90586283-4d89-44c8-b59e-8490adb60853 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.134837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90586283-4d89-44c8-b59e-8490adb60853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.142404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:31.146731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90586283-4d89-44c8-b59e-8490adb60853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.148295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90586283-4d89-44c8-b59e-8490adb60853 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-90586283-4d89-44c8-b59e-8490adb60853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:31.166544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:31.167666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:31.168750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:31.168750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:31.168750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:31.168750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:31.170390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 337/700] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:31.171421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90586283-4d89-44c8-b59e-8490adb60853 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.180301 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968e9f5f-f19d-45d4-931e-a9db3293e385 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:31.221977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989871d-c498-4b7c-9426-b745e802133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.222974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989871d-c498-4b7c-9426-b745e802133f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.223409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989871d-c498-4b7c-9426-b745e802133f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.223838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989871d-c498-4b7c-9426-b745e802133f None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.224793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989871d-c498-4b7c-9426-b745e802133f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:31.225302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989871d-c498-4b7c-9426-b745e802133f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.227187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989871d-c498-4b7c-9426-b745e802133f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.245411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 364/701] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:31.246678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989871d-c498-4b7c-9426-b745e802133f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.282988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90586283-4d89-44c8-b59e-8490adb60853 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:31.319046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23304299-2db6-4d69-972c-0ce5980c056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.319923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304299-2db6-4d69-972c-0ce5980c056c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.320300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304299-2db6-4d69-972c-0ce5980c056c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.320674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23304299-2db6-4d69-972c-0ce5980c056c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.332067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23304299-2db6-4d69-972c-0ce5980c056c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.333689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23304299-2db6-4d69-972c-0ce5980c056c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-23304299-2db6-4d69-972c-0ce5980c056c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:31.351574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:31.352723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:31.353667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:31.353667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:31.353667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:31.353667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:31.358983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 338/702] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:31.358983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23304299-2db6-4d69-972c-0ce5980c056c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.367029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989871d-c498-4b7c-9426-b745e802133f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:31.392276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:31.401838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:31.407889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bfe40-9449-49e4-9727-9ab6823325c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.409388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bfe40-9449-49e4-9727-9ab6823325c2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.409848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bfe40-9449-49e4-9727-9ab6823325c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.410298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bfe40-9449-49e4-9727-9ab6823325c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.411160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bfe40-9449-49e4-9727-9ab6823325c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:31.411612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bfe40-9449-49e4-9727-9ab6823325c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.413189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bfe40-9449-49e4-9727-9ab6823325c2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.426303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 365/703] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:31.427246 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bfe40-9449-49e4-9727-9ab6823325c2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.465935 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23304299-2db6-4d69-972c-0ce5980c056c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:31.502715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dd8895-e690-47b4-926e-5dc6f439d192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.503378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd8895-e690-47b4-926e-5dc6f439d192 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.503662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd8895-e690-47b4-926e-5dc6f439d192 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.503939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dd8895-e690-47b4-926e-5dc6f439d192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.504791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd8895-e690-47b4-926e-5dc6f439d192 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=eb66b6f6b5524f3687411fa83d525acc) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:31.505090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd8895-e690-47b4-926e-5dc6f439d192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.506573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dd8895-e690-47b4-926e-5dc6f439d192 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.512589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 339/704] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:31 2022] GET /identity/v3/role_assignments?user.id=eb66b6f6b5524f3687411fa83d525acc&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=308d9785120a49079e02659953a2b033 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:31.513890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c9d6d-11dd-405b-b257-d505b7d40293 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.514210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c9d6d-11dd-405b-b257-d505b7d40293 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.514493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c9d6d-11dd-405b-b257-d505b7d40293 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.515933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 340/705] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:31.516500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c9d6d-11dd-405b-b257-d505b7d40293 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.556400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bfe40-9449-49e4-9727-9ab6823325c2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:31.600201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ce080-b6a1-4f21-bd00-bb0f52ebe96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.601486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ce080-b6a1-4f21-bd00-bb0f52ebe96a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.601917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ce080-b6a1-4f21-bd00-bb0f52ebe96a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.602665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ce080-b6a1-4f21-bd00-bb0f52ebe96a None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.604600 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ce080-b6a1-4f21-bd00-bb0f52ebe96a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:31.605074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ce080-b6a1-4f21-bd00-bb0f52ebe96a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.606673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ce080-b6a1-4f21-bd00-bb0f52ebe96a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.623803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 366/706] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:31.625437 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85140e8a-4d47-4c0e-a976-633732f7757e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.625908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85140e8a-4d47-4c0e-a976-633732f7757e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.626450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85140e8a-4d47-4c0e-a976-633732f7757e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.640781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:31.646747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c9d6d-11dd-405b-b257-d505b7d40293 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:31.653210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-85140e8a-4d47-4c0e-a976-633732f7757e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:31.655433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-85140e8a-4d47-4c0e-a976-633732f7757e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:31.685258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eca42f-f4ac-4f5d-ba30-0f8a2ed3fd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.686378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eca42f-f4ac-4f5d-ba30-0f8a2ed3fd8e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.686493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eca42f-f4ac-4f5d-ba30-0f8a2ed3fd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.686735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eca42f-f4ac-4f5d-ba30-0f8a2ed3fd8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.696210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eca42f-f4ac-4f5d-ba30-0f8a2ed3fd8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.697619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eca42f-f4ac-4f5d-ba30-0f8a2ed3fd8e None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-f5eca42f-f4ac-4f5d-ba30-0f8a2ed3fd8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:31.715680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:31.716685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:31.717566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:31.717566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:31.717566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:31.717566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:31.717566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:31.717566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:31.717566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:31.717566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:31.722746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 341/707] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:31.723670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eca42f-f4ac-4f5d-ba30-0f8a2ed3fd8e None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.728534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:31.753152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 367/708] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:31.754019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85140e8a-4d47-4c0e-a976-633732f7757e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.870161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eca42f-f4ac-4f5d-ba30-0f8a2ed3fd8e None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:31.884079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85140e8a-4d47-4c0e-a976-633732f7757e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:31.910470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18a579-962a-4e68-9dba-cbfe1a5e03f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.911211 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a579-962a-4e68-9dba-cbfe1a5e03f8 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.911491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a579-962a-4e68-9dba-cbfe1a5e03f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.911767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18a579-962a-4e68-9dba-cbfe1a5e03f8 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.912481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18a579-962a-4e68-9dba-cbfe1a5e03f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.913967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18a579-962a-4e68-9dba-cbfe1a5e03f8 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.924904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45122137-77ca-46a5-aeb1-183fbc5f30f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:31.925574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45122137-77ca-46a5-aeb1-183fbc5f30f8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.925891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45122137-77ca-46a5-aeb1-183fbc5f30f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.926155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45122137-77ca-46a5-aeb1-183fbc5f30f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.926949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45122137-77ca-46a5-aeb1-183fbc5f30f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:31.927275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45122137-77ca-46a5-aeb1-183fbc5f30f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:31.928695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45122137-77ca-46a5-aeb1-183fbc5f30f8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:31.938173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 342/709] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:29:31 2022] POST /identity/v3/users => generated 254 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:31.938173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18a579-962a-4e68-9dba-cbfe1a5e03f8 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.946209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 368/710] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:31.946209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4214061-1cd7-4087-a951-f2e621164082 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:31.946209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4214061-1cd7-4087-a951-f2e621164082 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:31.946209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4214061-1cd7-4087-a951-f2e621164082 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:31.946209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 369/711] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:31.947772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4214061-1cd7-4087-a951-f2e621164082 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:31.986415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:32.001405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:32.070134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4214061-1cd7-4087-a951-f2e621164082 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:32.107815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f51098-efee-4f21-944d-57c6a668f086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:32.108737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51098-efee-4f21-944d-57c6a668f086 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:32.109191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51098-efee-4f21-944d-57c6a668f086 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:32.109470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f51098-efee-4f21-944d-57c6a668f086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:32.110360 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f51098-efee-4f21-944d-57c6a668f086 None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=fa04ddd7a6ce4bbabdfca31721b9c71d) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:32.110674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f51098-efee-4f21-944d-57c6a668f086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:32.112480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18a579-962a-4e68-9dba-cbfe1a5e03f8 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:32.112746 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f51098-efee-4f21-944d-57c6a668f086 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:32.126117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 370/712] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:31 2022] GET /identity/v3/role_assignments?user.id=fa04ddd7a6ce4bbabdfca31721b9c71d&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:32.126117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad022d5-fbb9-455d-b5ae-15281952747b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:32.126117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad022d5-fbb9-455d-b5ae-15281952747b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:32.126117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad022d5-fbb9-455d-b5ae-15281952747b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:32.157672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5ad022d5-fbb9-455d-b5ae-15281952747b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:32.161295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5ad022d5-fbb9-455d-b5ae-15281952747b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:32.189239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539cb2c-ff27-41a6-8f34-61571f08e41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:32.190247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539cb2c-ff27-41a6-8f34-61571f08e41a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:32.190534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539cb2c-ff27-41a6-8f34-61571f08e41a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:32.190811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539cb2c-ff27-41a6-8f34-61571f08e41a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:32.191803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539cb2c-ff27-41a6-8f34-61571f08e41a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:32.194128 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539cb2c-ff27-41a6-8f34-61571f08e41a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-9539cb2c-ff27-41a6-8f34-61571f08e41a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:32.214131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:32.215222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:32.216496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 343/713] 10.222.0.79 () {56 vars in 1129 bytes} [Wed May 25 14:29:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:32.223301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539cb2c-ff27-41a6-8f34-61571f08e41a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:32.250141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 371/714] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:32.278409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad022d5-fbb9-455d-b5ae-15281952747b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:32.332404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:32.350969 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:32.379562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539cb2c-ff27-41a6-8f34-61571f08e41a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:32.413302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad022d5-fbb9-455d-b5ae-15281952747b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:32.428221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55fad5-3805-4ea2-a73f-4167cba6c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:32.428891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55fad5-3805-4ea2-a73f-4167cba6c00f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:32.429174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55fad5-3805-4ea2-a73f-4167cba6c00f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:32.429451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55fad5-3805-4ea2-a73f-4167cba6c00f None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:32.430195 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55fad5-3805-4ea2-a73f-4167cba6c00f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:32.430510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55fad5-3805-4ea2-a73f-4167cba6c00f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:32.431960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55fad5-3805-4ea2-a73f-4167cba6c00f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:32.438116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 344/715] 10.222.0.79 () {56 vars in 1124 bytes} [Wed May 25 14:29:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:32.444684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55fad5-3805-4ea2-a73f-4167cba6c00f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:32.461995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aab76f-981a-418f-87ba-be9e85aef48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:32.463275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aab76f-981a-418f-87ba-be9e85aef48d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:32.463743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aab76f-981a-418f-87ba-be9e85aef48d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:32.464324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aab76f-981a-418f-87ba-be9e85aef48d None admin] PATH_INFO: `/v3/services/network` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:32.465047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aab76f-981a-418f-87ba-be9e85aef48d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:32.466525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aab76f-981a-418f-87ba-be9e85aef48d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-58aab76f-981a-418f-87ba-be9e85aef48d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:32.482628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:32.483637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:32.484885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 372/716] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:32 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:32.490676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aab76f-981a-418f-87ba-be9e85aef48d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:32.581398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55fad5-3805-4ea2-a73f-4167cba6c00f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:32.610294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:32.616194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aab76f-981a-418f-87ba-be9e85aef48d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:32.625814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da157c-45b9-4c26-9170-4dc3acd28232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:32.626601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da157c-45b9-4c26-9170-4dc3acd28232 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:32.626960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da157c-45b9-4c26-9170-4dc3acd28232 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:32.627837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da157c-45b9-4c26-9170-4dc3acd28232 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:32.628627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da157c-45b9-4c26-9170-4dc3acd28232 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:32.629008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da157c-45b9-4c26-9170-4dc3acd28232 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:32.630573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da157c-45b9-4c26-9170-4dc3acd28232 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:32.642112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 345/717] 10.222.0.79 () {56 vars in 1124 bytes} [Wed May 25 14:29:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:32.663401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0fbd12-f346-42f2-9af8-191c13559eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:32.664382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fbd12-f346-42f2-9af8-191c13559eda None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:32.664816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fbd12-f346-42f2-9af8-191c13559eda None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:32.665232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0fbd12-f346-42f2-9af8-191c13559eda None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:32.666186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fbd12-f346-42f2-9af8-191c13559eda None admin] RBAC: Adding query filter params (name=network) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:32.666643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fbd12-f346-42f2-9af8-191c13559eda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:32.668235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0fbd12-f346-42f2-9af8-191c13559eda None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:32.674333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 373/718] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:29:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:32.682163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da157c-45b9-4c26-9170-4dc3acd28232 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:32.700158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:32.809603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da157c-45b9-4c26-9170-4dc3acd28232 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:32.847458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64eff1b-2b05-4f46-be71-34d4798e6ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:32.848360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64eff1b-2b05-4f46-be71-34d4798e6ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:32.848779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64eff1b-2b05-4f46-be71-34d4798e6ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:32.849181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64eff1b-2b05-4f46-be71-34d4798e6ef4 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:32.850016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64eff1b-2b05-4f46-be71-34d4798e6ef4 None admin] RBAC: Adding query filter params (type=network) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:32.850499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64eff1b-2b05-4f46-be71-34d4798e6ef4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:32.852163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64eff1b-2b05-4f46-be71-34d4798e6ef4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:32.858455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 346/719] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:29:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:33.964920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd16a-7683-4aeb-8114-51b30e2bb1ea None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:33.965458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd16a-7683-4aeb-8114-51b30e2bb1ea None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:33.965458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd16a-7683-4aeb-8114-51b30e2bb1ea None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:33.967089 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 374/720] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:33.973230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f12a53-a160-4b86-82a3-6971d82ead0d None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:33.973627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f12a53-a160-4b86-82a3-6971d82ead0d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:33.973819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f12a53-a160-4b86-82a3-6971d82ead0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:33.999044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-75f12a53-a160-4b86-82a3-6971d82ead0d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:34.000241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-75f12a53-a160-4b86-82a3-6971d82ead0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:34.077775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 347/721] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:34.112299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd16a-7683-4aeb-8114-51b30e2bb1ea None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:34.244067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd16a-7683-4aeb-8114-51b30e2bb1ea None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:34.285850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6be53-d39d-4db6-a79d-4b1f666c6fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:34.286672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6be53-d39d-4db6-a79d-4b1f666c6fef None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:34.286952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6be53-d39d-4db6-a79d-4b1f666c6fef None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:34.287225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6be53-d39d-4db6-a79d-4b1f666c6fef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:34.303953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6be53-d39d-4db6-a79d-4b1f666c6fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-37d6be53-d39d-4db6-a79d-4b1f666c6fef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:34.311949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:34.312903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:34.313766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 375/722] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:34.319229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f12a53-a160-4b86-82a3-6971d82ead0d None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:34.321555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:34.444555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f12a53-a160-4b86-82a3-6971d82ead0d None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:34.479051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881355d4-d550-416f-9fca-ef67a11572b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:34.479722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881355d4-d550-416f-9fca-ef67a11572b6 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:34.480006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881355d4-d550-416f-9fca-ef67a11572b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:34.480281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881355d4-d550-416f-9fca-ef67a11572b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:34.481035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881355d4-d550-416f-9fca-ef67a11572b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:34.481342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881355d4-d550-416f-9fca-ef67a11572b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:34.482768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881355d4-d550-416f-9fca-ef67a11572b6 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:34.491746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 348/723] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:34.499176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6be53-d39d-4db6-a79d-4b1f666c6fef None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:34.533712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:34.637061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6be53-d39d-4db6-a79d-4b1f666c6fef None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:34.688502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bb101-4bee-4fce-b57d-e6ac9c4fb0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:34.689340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bb101-4bee-4fce-b57d-e6ac9c4fb0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:34.690178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bb101-4bee-4fce-b57d-e6ac9c4fb0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:34.690456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bb101-4bee-4fce-b57d-e6ac9c4fb0b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:34.708448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bb101-4bee-4fce-b57d-e6ac9c4fb0b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:34.709854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6bb101-4bee-4fce-b57d-e6ac9c4fb0b7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2e6bb101-4bee-4fce-b57d-e6ac9c4fb0b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:34.733050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:34.734100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:34.734987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:34.734987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:34.734987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:34.734987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:34.734987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 376/724] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:34.740495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881355d4-d550-416f-9fca-ef67a11572b6 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:34.886468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:34.917127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881355d4-d550-416f-9fca-ef67a11572b6 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:34.983155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e8ace-39cd-48f2-b702-6436720547bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:34.983990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e8ace-39cd-48f2-b702-6436720547bf None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:34.984282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e8ace-39cd-48f2-b702-6436720547bf None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:34.984564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e8ace-39cd-48f2-b702-6436720547bf None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:34.985312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e8ace-39cd-48f2-b702-6436720547bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:34.985624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e8ace-39cd-48f2-b702-6436720547bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:34.987089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e8ace-39cd-48f2-b702-6436720547bf None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:35.007342 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5e3f-c630-43a9-921c-57cb6c41dd2b None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.007879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5e3f-c630-43a9-921c-57cb6c41dd2b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.007879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983d5e3f-c630-43a9-921c-57cb6c41dd2b None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.008213 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 349/725] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:35.009238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 377/726] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:35.014014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e8ace-39cd-48f2-b702-6436720547bf None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:35.020144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320adef4-6745-404c-8aad-22d2e0301682 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.020443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320adef4-6745-404c-8aad-22d2e0301682 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.020701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320adef4-6745-404c-8aad-22d2e0301682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.037786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-320adef4-6745-404c-8aad-22d2e0301682 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:35.039199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-320adef4-6745-404c-8aad-22d2e0301682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:35.154956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 378/727] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 14:29:35.165012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e8ace-39cd-48f2-b702-6436720547bf None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:35.188883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320adef4-6745-404c-8aad-22d2e0301682 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:35.191527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:35.202383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:35.207496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd05cea-d4e5-4cce-a27a-0f517097ffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:35.208586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd05cea-d4e5-4cce-a27a-0f517097ffa7 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.209113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd05cea-d4e5-4cce-a27a-0f517097ffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.209612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd05cea-d4e5-4cce-a27a-0f517097ffa7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.218184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd05cea-d4e5-4cce-a27a-0f517097ffa7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:35.220047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd05cea-d4e5-4cce-a27a-0f517097ffa7 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-fdd05cea-d4e5-4cce-a27a-0f517097ffa7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:35.263150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:35.264121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:35.265051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 350/728] 10.222.0.79 () {56 vars in 1093 bytes} [Wed May 25 14:29:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:35.266152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d16d6-a9e6-418d-9d0a-61731ac71302 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.266319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d16d6-a9e6-418d-9d0a-61731ac71302 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.266594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d16d6-a9e6-418d-9d0a-61731ac71302 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.268924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 351/729] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:35.273275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d16d6-a9e6-418d-9d0a-61731ac71302 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:35.349964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320adef4-6745-404c-8aad-22d2e0301682 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:35.391966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d16d6-a9e6-418d-9d0a-61731ac71302 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:35.396155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05908566-915e-460b-be86-6f3d3c4325df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:35.397112 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05908566-915e-460b-be86-6f3d3c4325df None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.397493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05908566-915e-460b-be86-6f3d3c4325df None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.397866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05908566-915e-460b-be86-6f3d3c4325df None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.408909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05908566-915e-460b-be86-6f3d3c4325df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-05908566-915e-460b-be86-6f3d3c4325df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:35.417723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:35.418892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:35.419732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:35.424906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 379/730] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:35.426295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf13d78-0af6-4f3e-a837-1b7d174dd439 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.426653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf13d78-0af6-4f3e-a837-1b7d174dd439 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.427001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf13d78-0af6-4f3e-a837-1b7d174dd439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.437132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f809d-0102-4dd9-9cb5-657184d66008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:35.438071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f809d-0102-4dd9-9cb5-657184d66008 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.439089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f809d-0102-4dd9-9cb5-657184d66008 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.440099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f809d-0102-4dd9-9cb5-657184d66008 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.441427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f809d-0102-4dd9-9cb5-657184d66008 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:35.441945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f809d-0102-4dd9-9cb5-657184d66008 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:35.443621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f809d-0102-4dd9-9cb5-657184d66008 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:35.445015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4bf13d78-0af6-4f3e-a837-1b7d174dd439 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:35.446332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4bf13d78-0af6-4f3e-a837-1b7d174dd439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:35.465938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 352/731] 10.222.0.79 () {56 vars in 1133 bytes} [Wed May 25 14:29:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:35.466896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f809d-0102-4dd9-9cb5-657184d66008 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:35.519779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:35.533795 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:35.542732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 380/732] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:35.543957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf13d78-0af6-4f3e-a837-1b7d174dd439 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:35.579409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f809d-0102-4dd9-9cb5-657184d66008 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:35.626643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6474699-4365-4cf0-9f2d-56da32cc2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:35.627838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474699-4365-4cf0-9f2d-56da32cc2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.628120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474699-4365-4cf0-9f2d-56da32cc2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.628398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474699-4365-4cf0-9f2d-56da32cc2cd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.629149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6474699-4365-4cf0-9f2d-56da32cc2cd4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:35.629456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6474699-4365-4cf0-9f2d-56da32cc2cd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:35.630916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6474699-4365-4cf0-9f2d-56da32cc2cd4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:35.639422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 353/733] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:35.640625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130919b-2330-4336-92df-4538a633f986 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.640913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130919b-2330-4336-92df-4538a633f986 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.641188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130919b-2330-4336-92df-4538a633f986 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.642588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 354/734] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:35.643811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130919b-2330-4336-92df-4538a633f986 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:35.668285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf13d78-0af6-4f3e-a837-1b7d174dd439 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:35.704405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7410b43-1e8f-4db8-b49c-e61cb81dad05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:35.705255 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7410b43-1e8f-4db8-b49c-e61cb81dad05 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.706047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7410b43-1e8f-4db8-b49c-e61cb81dad05 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.706474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7410b43-1e8f-4db8-b49c-e61cb81dad05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.716385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7410b43-1e8f-4db8-b49c-e61cb81dad05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:35.717828 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7410b43-1e8f-4db8-b49c-e61cb81dad05 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a7410b43-1e8f-4db8-b49c-e61cb81dad05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:35.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:35.736336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:35.737312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:35.737312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:35.737312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:35.737312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:35.737312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 381/735] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:35.737867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625ce80-2de6-478d-a2bc-7361ba443e99 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.738066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625ce80-2de6-478d-a2bc-7361ba443e99 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.738440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1625ce80-2de6-478d-a2bc-7361ba443e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.751515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130919b-2330-4336-92df-4538a633f986 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:35.754328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:35.754693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1625ce80-2de6-478d-a2bc-7361ba443e99 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:35.756082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1625ce80-2de6-478d-a2bc-7361ba443e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:35.786246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded62af-0f5e-4489-808a-519e7d570e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:35.786973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded62af-0f5e-4489-808a-519e7d570e6f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.787254 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded62af-0f5e-4489-808a-519e7d570e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.787531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded62af-0f5e-4489-808a-519e7d570e6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.797379 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded62af-0f5e-4489-808a-519e7d570e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:35.801836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-1ded62af-0f5e-4489-808a-519e7d570e6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:35.805687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:35.806760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 355/736] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:35.808044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded62af-0f5e-4489-808a-519e7d570e6f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:35.831037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 382/737] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:35.832342 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1c43-93d4-4400-97b1-3ed8d51fe5fc None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.832633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1c43-93d4-4400-97b1-3ed8d51fe5fc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.832932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d1c43-93d4-4400-97b1-3ed8d51fe5fc None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.834191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 383/738] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:35.834887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1c43-93d4-4400-97b1-3ed8d51fe5fc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:35.909967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded62af-0f5e-4489-808a-519e7d570e6f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:35.940698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d1c43-93d4-4400-97b1-3ed8d51fe5fc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:35.943197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ec09d-d589-414b-a77c-686cc9366012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:35.944057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ec09d-d589-414b-a77c-686cc9366012 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.944340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ec09d-d589-414b-a77c-686cc9366012 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.944612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936ec09d-d589-414b-a77c-686cc9366012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.955248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ec09d-d589-414b-a77c-686cc9366012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:35.956620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936ec09d-d589-414b-a77c-686cc9366012 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-936ec09d-d589-414b-a77c-686cc9366012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:35.973266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:35.974327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:35.975214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:35.975214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:35.975214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:35.975214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:35.975428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68196d0f-3cf2-4335-867d-acebcd174b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:35.975428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68196d0f-3cf2-4335-867d-acebcd174b1e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.975428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68196d0f-3cf2-4335-867d-acebcd174b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.975428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68196d0f-3cf2-4335-867d-acebcd174b1e None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.975679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 356/739] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:35.975745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68196d0f-3cf2-4335-867d-acebcd174b1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:35.975745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68196d0f-3cf2-4335-867d-acebcd174b1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:35.975861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ec09d-d589-414b-a77c-686cc9366012 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:35.976851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68196d0f-3cf2-4335-867d-acebcd174b1e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:35.989358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 384/740] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:35.990490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583d46-193f-4f0c-b2a3-47784545f9b0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:35.990815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583d46-193f-4f0c-b2a3-47784545f9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:35.991051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1583d46-193f-4f0c-b2a3-47784545f9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:35.994321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:36.008313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a1583d46-193f-4f0c-b2a3-47784545f9b0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:36.009501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a1583d46-193f-4f0c-b2a3-47784545f9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:36.039493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:36.075735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936ec09d-d589-414b-a77c-686cc9366012 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.077369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 385/741] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 14:29:36.078198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1583d46-193f-4f0c-b2a3-47784545f9b0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:36.108926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69ba7-454c-4a31-82eb-a119860f6428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.109591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69ba7-454c-4a31-82eb-a119860f6428 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.109879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69ba7-454c-4a31-82eb-a119860f6428 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.110193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69ba7-454c-4a31-82eb-a119860f6428 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.110944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69ba7-454c-4a31-82eb-a119860f6428 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:36.111251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69ba7-454c-4a31-82eb-a119860f6428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.113139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69ba7-454c-4a31-82eb-a119860f6428 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:36.121125 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 357/742] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:36.122395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69ba7-454c-4a31-82eb-a119860f6428 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:36.184646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1583d46-193f-4f0c-b2a3-47784545f9b0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.199461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:36.217875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246715f1-2a57-4b69-ad6a-dde7af4b1592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.218562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246715f1-2a57-4b69-ad6a-dde7af4b1592 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.218843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246715f1-2a57-4b69-ad6a-dde7af4b1592 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.219108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246715f1-2a57-4b69-ad6a-dde7af4b1592 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.219836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246715f1-2a57-4b69-ad6a-dde7af4b1592 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.221183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69ba7-454c-4a31-82eb-a119860f6428 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.221300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246715f1-2a57-4b69-ad6a-dde7af4b1592 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:36.235572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 386/743] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:29:36 2022] POST /identity/v3/services => generated 240 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:36.236457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246715f1-2a57-4b69-ad6a-dde7af4b1592 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:36.267532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:36.280094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f34e7-f3d7-4b2b-8939-8fb806f8f9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.280771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f34e7-f3d7-4b2b-8939-8fb806f8f9ba None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.281049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f34e7-f3d7-4b2b-8939-8fb806f8f9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.281324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87f34e7-f3d7-4b2b-8939-8fb806f8f9ba None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.282052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f34e7-f3d7-4b2b-8939-8fb806f8f9ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:36.282388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f34e7-f3d7-4b2b-8939-8fb806f8f9ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.283828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87f34e7-f3d7-4b2b-8939-8fb806f8f9ba None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:36.297082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 358/744] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:36.297693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f34e7-f3d7-4b2b-8939-8fb806f8f9ba None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:36.355512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246715f1-2a57-4b69-ad6a-dde7af4b1592 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.396525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc8f1f-1e42-4a67-ba74-2b2ec85e1961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.397645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc8f1f-1e42-4a67-ba74-2b2ec85e1961 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.398028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc8f1f-1e42-4a67-ba74-2b2ec85e1961 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.398436 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fc8f1f-1e42-4a67-ba74-2b2ec85e1961 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.406859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc8f1f-1e42-4a67-ba74-2b2ec85e1961 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.408568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fc8f1f-1e42-4a67-ba74-2b2ec85e1961 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-c7fc8f1f-1e42-4a67-ba74-2b2ec85e1961 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:36.424854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:36.425987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:36.427149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:36.427149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:36.427149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:36.427149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:36.427149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:36.427149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:36.427149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:36.427149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:36.427149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 387/745] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:36.428005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc8f1f-1e42-4a67-ba74-2b2ec85e1961 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:36.529357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:36.537465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87f34e7-f3d7-4b2b-8939-8fb806f8f9ba None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.543525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fc8f1f-1e42-4a67-ba74-2b2ec85e1961 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.576201 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44417d8-30a0-407b-a57f-786ca0488c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.576764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44417d8-30a0-407b-a57f-786ca0488c2a None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.577043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44417d8-30a0-407b-a57f-786ca0488c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.577311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44417d8-30a0-407b-a57f-786ca0488c2a None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.578034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44417d8-30a0-407b-a57f-786ca0488c2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.579431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44417d8-30a0-407b-a57f-786ca0488c2a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:36.581267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cab85-850b-421c-b212-6ca5aa5dc476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.582254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cab85-850b-421c-b212-6ca5aa5dc476 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.582491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:36.582590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cab85-850b-421c-b212-6ca5aa5dc476 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.582796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9cab85-850b-421c-b212-6ca5aa5dc476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.594676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cab85-850b-421c-b212-6ca5aa5dc476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.596687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 359/746] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:29:36 2022] POST /identity/v3/services => generated 251 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:36.596800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9cab85-850b-421c-b212-6ca5aa5dc476 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:36.603227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44417d8-30a0-407b-a57f-786ca0488c2a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0f9cab85-850b-421c-b212-6ca5aa5dc476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:36.615696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:36.616880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:36.617990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:36.617990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:36.617990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:36.617990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:36.621649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 388/747] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:36.630122 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cab85-850b-421c-b212-6ca5aa5dc476 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:36.743931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44417d8-30a0-407b-a57f-786ca0488c2a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.745371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9cab85-850b-421c-b212-6ca5aa5dc476 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.782903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdd5fc-3889-49cb-8c3d-b76bb0ab5efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.784329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdd5fc-3889-49cb-8c3d-b76bb0ab5efb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.784609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdd5fc-3889-49cb-8c3d-b76bb0ab5efb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.784884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdd5fc-3889-49cb-8c3d-b76bb0ab5efb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.787324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3122d40-50d7-4925-8071-061a545874b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.788761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122d40-50d7-4925-8071-061a545874b8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.788761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122d40-50d7-4925-8071-061a545874b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.788761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3122d40-50d7-4925-8071-061a545874b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.789800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3122d40-50d7-4925-8071-061a545874b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:36.790250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3122d40-50d7-4925-8071-061a545874b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.791853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3122d40-50d7-4925-8071-061a545874b8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:36.792795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdd5fc-3889-49cb-8c3d-b76bb0ab5efb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.794465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdd5fc-3889-49cb-8c3d-b76bb0ab5efb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:36.807152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 389/748] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:36.808116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3122d40-50d7-4925-8071-061a545874b8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-e4cdd5fc-3889-49cb-8c3d-b76bb0ab5efb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:36.812391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:36.813308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:36.814346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:36.814346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:36.814346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:36.814346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:36.814346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:36.814346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:36.814346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:36.814346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:36.814346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:29:36.814346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:36.814910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 360/749] 10.222.0.79 () {56 vars in 1117 bytes} [Wed May 25 14:29:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:36.815571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdd5fc-3889-49cb-8c3d-b76bb0ab5efb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:36.821398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:36.876595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:36.942177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdd5fc-3889-49cb-8c3d-b76bb0ab5efb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.945621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3122d40-50d7-4925-8071-061a545874b8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:36.983795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8019d0-26d3-4ac9-9e6e-5bd51dccc9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.984719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8019d0-26d3-4ac9-9e6e-5bd51dccc9d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.985047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8019d0-26d3-4ac9-9e6e-5bd51dccc9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.985329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8019d0-26d3-4ac9-9e6e-5bd51dccc9d3 None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/eb66b6f6b5524f3687411fa83d525acc/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.986434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee64885-79e2-4d1f-9e3d-eabd216c36f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:36.987413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee64885-79e2-4d1f-9e3d-eabd216c36f8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:36.987522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8019d0-26d3-4ac9-9e6e-5bd51dccc9d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=eb66b6f6b5524f3687411fa83d525acc, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.987993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee64885-79e2-4d1f-9e3d-eabd216c36f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:36.988484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee64885-79e2-4d1f-9e3d-eabd216c36f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:36.988892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8019d0-26d3-4ac9-9e6e-5bd51dccc9d3 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:36.989626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee64885-79e2-4d1f-9e3d-eabd216c36f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:36.990166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee64885-79e2-4d1f-9e3d-eabd216c36f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:36.991939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee64885-79e2-4d1f-9e3d-eabd216c36f8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:37.004166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 361/750] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:29:36 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/eb66b6f6b5524f3687411fa83d525acc/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:37.005317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8019d0-26d3-4ac9-9e6e-5bd51dccc9d3 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:37.014709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 390/751] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:37.021086 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee64885-79e2-4d1f-9e3d-eabd216c36f8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:37.136585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8019d0-26d3-4ac9-9e6e-5bd51dccc9d3 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:37.149629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:37.162493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:37.183965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab769951-1301-463b-aa0b-3fb83602fb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:37.184973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab769951-1301-463b-aa0b-3fb83602fb67 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:37.185391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab769951-1301-463b-aa0b-3fb83602fb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:37.185873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab769951-1301-463b-aa0b-3fb83602fb67 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:37.186944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab769951-1301-463b-aa0b-3fb83602fb67 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:37.187419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab769951-1301-463b-aa0b-3fb83602fb67 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:37.188905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab769951-1301-463b-aa0b-3fb83602fb67 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:37.210443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 362/752] 10.222.0.79 () {56 vars in 1149 bytes} [Wed May 25 14:29:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:37.216597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab769951-1301-463b-aa0b-3fb83602fb67 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:37.230530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee64885-79e2-4d1f-9e3d-eabd216c36f8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:37.305118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f19a-d0bf-4a78-8510-39694951fec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:37.305916 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f19a-d0bf-4a78-8510-39694951fec0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:37.306219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f19a-d0bf-4a78-8510-39694951fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:37.306488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59f19a-d0bf-4a78-8510-39694951fec0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:37.320712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59f19a-d0bf-4a78-8510-39694951fec0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:37.323306 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59f19a-d0bf-4a78-8510-39694951fec0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3a59f19a-d0bf-4a78-8510-39694951fec0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:37.350018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:37.351003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:37.351932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 391/753] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:37.359042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f19a-d0bf-4a78-8510-39694951fec0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:37.368999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab769951-1301-463b-aa0b-3fb83602fb67 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:37.415714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5c65b-e096-41e3-9359-d972ec0d9de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:37.416380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5c65b-e096-41e3-9359-d972ec0d9de2 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:37.416656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5c65b-e096-41e3-9359-d972ec0d9de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:37.416924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb5c65b-e096-41e3-9359-d972ec0d9de2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:37.478704 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:37.515649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59f19a-d0bf-4a78-8510-39694951fec0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:37.542938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5c65b-e096-41e3-9359-d972ec0d9de2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:37.544512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb5c65b-e096-41e3-9359-d972ec0d9de2 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:37.550441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:37.577853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c9e89-8640-4f4f-ba52-34949dab64df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:37.578911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9e89-8640-4f4f-ba52-34949dab64df None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:37.579393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9e89-8640-4f4f-ba52-34949dab64df None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:37.579859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c9e89-8640-4f4f-ba52-34949dab64df None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:37.581445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c9e89-8640-4f4f-ba52-34949dab64df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:37.582565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c9e89-8640-4f4f-ba52-34949dab64df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:37.586535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c9e89-8640-4f4f-ba52-34949dab64df None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:37.619716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 392/754] 10.222.0.79 () {56 vars in 1135 bytes} [Wed May 25 14:29:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:37.631064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c9e89-8640-4f4f-ba52-34949dab64df None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:37.729686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 363/755] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:37.735052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5c65b-e096-41e3-9359-d972ec0d9de2 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:37.803533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c9e89-8640-4f4f-ba52-34949dab64df None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:37.855225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:37.870839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670952-ad44-4e0e-9fcc-013c321d8241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:37.871495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670952-ad44-4e0e-9fcc-013c321d8241 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:37.871776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670952-ad44-4e0e-9fcc-013c321d8241 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:37.872050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670952-ad44-4e0e-9fcc-013c321d8241 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:37.904383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb5c65b-e096-41e3-9359-d972ec0d9de2 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:37.968678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c7952-fd75-4ead-953f-a310e6856458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:37.969479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c7952-fd75-4ead-953f-a310e6856458 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:37.969760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c7952-fd75-4ead-953f-a310e6856458 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:37.970033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c7952-fd75-4ead-953f-a310e6856458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:37.976302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:37.991892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c7952-fd75-4ead-953f-a310e6856458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:37.994500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c7952-fd75-4ead-953f-a310e6856458 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:38.022134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b670952-ad44-4e0e-9fcc-013c321d8241 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:38.023740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b670952-ad44-4e0e-9fcc-013c321d8241 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-8f1c7952-fd75-4ead-953f-a310e6856458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:38.028347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:38.029503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:38.030400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:38.030400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:38.030400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:38.030400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:38.035276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 364/756] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:38.040196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c7952-fd75-4ead-953f-a310e6856458 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:38.166681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 393/757] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:38.171895 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670952-ad44-4e0e-9fcc-013c321d8241 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:38.244415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c7952-fd75-4ead-953f-a310e6856458 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:38.274065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:38.304571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:38.315428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2934bb-9195-4fea-9fc7-0f360182d937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:38.316350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2934bb-9195-4fea-9fc7-0f360182d937 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:38.316660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2934bb-9195-4fea-9fc7-0f360182d937 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:38.316964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2934bb-9195-4fea-9fc7-0f360182d937 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:38.317657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2934bb-9195-4fea-9fc7-0f360182d937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:38.317964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2934bb-9195-4fea-9fc7-0f360182d937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:38.319381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2934bb-9195-4fea-9fc7-0f360182d937 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:38.322377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670952-ad44-4e0e-9fcc-013c321d8241 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:38.350120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 365/758] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:38.355033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2934bb-9195-4fea-9fc7-0f360182d937 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:38.364089 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5663380-98c7-4184-a1f3-f7a788ccafbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:38.364928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5663380-98c7-4184-a1f3-f7a788ccafbf None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:38.365205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5663380-98c7-4184-a1f3-f7a788ccafbf None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:38.365522 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5663380-98c7-4184-a1f3-f7a788ccafbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:38.375687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5663380-98c7-4184-a1f3-f7a788ccafbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:38.377728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5663380-98c7-4184-a1f3-f7a788ccafbf None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a5663380-98c7-4184-a1f3-f7a788ccafbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:38.395637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:38.396540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:38.397412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:38.397412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:38.397412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:38.397412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:38.397412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 394/759] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:38.402366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5663380-98c7-4184-a1f3-f7a788ccafbf None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:38.543599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2934bb-9195-4fea-9fc7-0f360182d937 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:38.563785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5663380-98c7-4184-a1f3-f7a788ccafbf None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:38.617812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c46e-f133-4251-abc9-7ade94998989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:38.618639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c46e-f133-4251-abc9-7ade94998989 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:38.618915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c46e-f133-4251-abc9-7ade94998989 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:38.619186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d2c46e-f133-4251-abc9-7ade94998989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:38.621982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:38.629955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8012c54-b5c9-4d0e-8405-62e02110bd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:38.630648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012c54-b5c9-4d0e-8405-62e02110bd69 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:38.630926 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012c54-b5c9-4d0e-8405-62e02110bd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:38.631195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8012c54-b5c9-4d0e-8405-62e02110bd69 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:38.631917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8012c54-b5c9-4d0e-8405-62e02110bd69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:38.632218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8012c54-b5c9-4d0e-8405-62e02110bd69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:38.633593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8012c54-b5c9-4d0e-8405-62e02110bd69 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:38.637929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2c46e-f133-4251-abc9-7ade94998989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:38.639393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d2c46e-f133-4251-abc9-7ade94998989 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:38.661855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 395/760] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-a6d2c46e-f133-4251-abc9-7ade94998989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:38.669216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:38.670067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:38.670964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:38.670964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:38.670964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:38.670964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:38.670964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:38.670964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:38.670964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:38.670964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:38.670964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 366/761] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:38.676805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8012c54-b5c9-4d0e-8405-62e02110bd69 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:38.680362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c46e-f133-4251-abc9-7ade94998989 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:38.760583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:38.820484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d2c46e-f133-4251-abc9-7ade94998989 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:38.832051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8012c54-b5c9-4d0e-8405-62e02110bd69 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:38.865279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375041f6-8563-47f7-abb8-22994dde54dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:38.866483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375041f6-8563-47f7-abb8-22994dde54dd None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:38.866908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375041f6-8563-47f7-abb8-22994dde54dd None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:38.867321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375041f6-8563-47f7-abb8-22994dde54dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:38.867433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28958f5-2f81-412b-ae54-b47d9d156c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:38.868182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28958f5-2f81-412b-ae54-b47d9d156c48 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:38.868568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28958f5-2f81-412b-ae54-b47d9d156c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:38.868943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28958f5-2f81-412b-ae54-b47d9d156c48 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:38.869844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28958f5-2f81-412b-ae54-b47d9d156c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:38.870279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28958f5-2f81-412b-ae54-b47d9d156c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:38.871833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28958f5-2f81-412b-ae54-b47d9d156c48 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:38.875909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375041f6-8563-47f7-abb8-22994dde54dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:38.878070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375041f6-8563-47f7-abb8-22994dde54dd None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:38.889882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 396/762] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:38.889882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a36e-fbfd-4206-acda-8cc7ef0eb50c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:38.889882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a36e-fbfd-4206-acda-8cc7ef0eb50c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:38.889882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0a36e-fbfd-4206-acda-8cc7ef0eb50c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:38.889882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 397/763] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:38.891072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a36e-fbfd-4206-acda-8cc7ef0eb50c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-375041f6-8563-47f7-abb8-22994dde54dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:38.900545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:38.901495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:38.902388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:38.902388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:38.902388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:38.902388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:38.902388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:38.902388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:38.902388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:38.902388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:38.905067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 367/764] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:38.910610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21c01-8470-4951-9f57-17b98cabe6ae None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:38.910610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21c01-8470-4951-9f57-17b98cabe6ae None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:38.910610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d21c01-8470-4951-9f57-17b98cabe6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:38.933522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c9d21c01-8470-4951-9f57-17b98cabe6ae None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:38.934755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c9d21c01-8470-4951-9f57-17b98cabe6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:38.963995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:39.009661 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 368/765] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:39.011874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21c01-8470-4951-9f57-17b98cabe6ae None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:39.049332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0a36e-fbfd-4206-acda-8cc7ef0eb50c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:39.060669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:39.093173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a555944-6273-4a19-a5ff-4cfcb743917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:39.093907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a555944-6273-4a19-a5ff-4cfcb743917c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.094224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a555944-6273-4a19-a5ff-4cfcb743917c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.094820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a555944-6273-4a19-a5ff-4cfcb743917c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.095992 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a555944-6273-4a19-a5ff-4cfcb743917c None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=be474c0453a0403b8db884a89fe9e486) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:39.096306 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a555944-6273-4a19-a5ff-4cfcb743917c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:39.098467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a555944-6273-4a19-a5ff-4cfcb743917c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:39.105764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 398/766] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:38 2022] GET /identity/v3/role_assignments?user.id=be474c0453a0403b8db884a89fe9e486&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:39.106893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a555944-6273-4a19-a5ff-4cfcb743917c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:39.149116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d21c01-8470-4951-9f57-17b98cabe6ae None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:39.202399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ed32-8bbd-4eb9-b979-e8e023d5094f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:39.202644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ed32-8bbd-4eb9-b979-e8e023d5094f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.202948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ed32-8bbd-4eb9-b979-e8e023d5094f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.203229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ed32-8bbd-4eb9-b979-e8e023d5094f None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.204046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0ed32-8bbd-4eb9-b979-e8e023d5094f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:39.204409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0ed32-8bbd-4eb9-b979-e8e023d5094f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:39.206031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0ed32-8bbd-4eb9-b979-e8e023d5094f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:39.220008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 369/767] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:39.222253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f384-6602-4b45-a34e-64e035436180 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.222546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f384-6602-4b45-a34e-64e035436180 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.222864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77f384-6602-4b45-a34e-64e035436180 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.224619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 370/768] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:39.225836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77f384-6602-4b45-a34e-64e035436180 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:39.242219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a555944-6273-4a19-a5ff-4cfcb743917c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:39.258791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:39.285674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153de877-6710-4f17-865a-4946015ea32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:39.287140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153de877-6710-4f17-865a-4946015ea32c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.287664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153de877-6710-4f17-865a-4946015ea32c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.288283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153de877-6710-4f17-865a-4946015ea32c None admin] PATH_INFO: `/v3/services/network` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.289216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153de877-6710-4f17-865a-4946015ea32c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:39.291108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153de877-6710-4f17-865a-4946015ea32c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-153de877-6710-4f17-865a-4946015ea32c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:39.305982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:39.307090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:29:39.307940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:39.311284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 399/769] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:39 2022] GET /identity/v3/services/network => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:39.313121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dcf03-502e-4d46-b73f-2456dcc3f8ea None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.313684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dcf03-502e-4d46-b73f-2456dcc3f8ea None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.314213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dcf03-502e-4d46-b73f-2456dcc3f8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.336406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-110dcf03-502e-4d46-b73f-2456dcc3f8ea None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:39.337976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-110dcf03-502e-4d46-b73f-2456dcc3f8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:39.353187 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:39.369336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77f384-6602-4b45-a34e-64e035436180 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:39.413195 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bebfcd-e5d0-4a87-aeb1-fd977d6f0dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:39.414282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bebfcd-e5d0-4a87-aeb1-fd977d6f0dae None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.414393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 400/770] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:39.414866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bebfcd-e5d0-4a87-aeb1-fd977d6f0dae None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.415362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bebfcd-e5d0-4a87-aeb1-fd977d6f0dae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.415468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dcf03-502e-4d46-b73f-2456dcc3f8ea None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:39.416486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bebfcd-e5d0-4a87-aeb1-fd977d6f0dae None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=fa04ddd7a6ce4bbabdfca31721b9c71d) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:39.416998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bebfcd-e5d0-4a87-aeb1-fd977d6f0dae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:39.419717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bebfcd-e5d0-4a87-aeb1-fd977d6f0dae None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:39.427597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 371/771] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:39 2022] GET /identity/v3/role_assignments?user.id=fa04ddd7a6ce4bbabdfca31721b9c71d&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=308d9785120a49079e02659953a2b033 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:39.441683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bebfcd-e5d0-4a87-aeb1-fd977d6f0dae None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:39.531523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dcf03-502e-4d46-b73f-2456dcc3f8ea None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:39.542523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:39.555273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bebfcd-e5d0-4a87-aeb1-fd977d6f0dae None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:39.582406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6ac1-f6e1-4e96-9b8a-cd0ceb458df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:39.583669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6ac1-f6e1-4e96-9b8a-cd0ceb458df4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.584190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6ac1-f6e1-4e96-9b8a-cd0ceb458df4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.584794 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6ac1-f6e1-4e96-9b8a-cd0ceb458df4 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.585602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6ac1-f6e1-4e96-9b8a-cd0ceb458df4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:39.585980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6ac1-f6e1-4e96-9b8a-cd0ceb458df4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:39.588523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6ac1-f6e1-4e96-9b8a-cd0ceb458df4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:39.596470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c89033-34b7-4306-a72a-663225c98ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:39.597648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c89033-34b7-4306-a72a-663225c98ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.598123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c89033-34b7-4306-a72a-663225c98ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.598599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c89033-34b7-4306-a72a-663225c98ad0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.599457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c89033-34b7-4306-a72a-663225c98ad0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:39.600238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 401/772] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:29:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:39.601529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c89033-34b7-4306-a72a-663225c98ad0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:39.601869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90bcab-b8bf-49c8-983c-936a7d4bfc8c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.602255 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90bcab-b8bf-49c8-983c-936a7d4bfc8c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.602619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90bcab-b8bf-49c8-983c-936a7d4bfc8c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.604710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 402/773] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:39.605534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90bcab-b8bf-49c8-983c-936a7d4bfc8c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-77c89033-34b7-4306-a72a-663225c98ad0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:39.617469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:39.618514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:29:39.619340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:39.627947 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 372/774] 10.222.0.79 () {56 vars in 1129 bytes} [Wed May 25 14:29:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:39.629772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f25dd-f803-43cb-92cd-e71d147fc6c6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.630364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f25dd-f803-43cb-92cd-e71d147fc6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.630870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f25dd-f803-43cb-92cd-e71d147fc6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.649907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d39f25dd-f803-43cb-92cd-e71d147fc6c6 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:39.651527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d39f25dd-f803-43cb-92cd-e71d147fc6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:39.670859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:39.731760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90bcab-b8bf-49c8-983c-936a7d4bfc8c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:39.750229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 373/775] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:39.751234 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f25dd-f803-43cb-92cd-e71d147fc6c6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:39.775934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da781b2-9d56-4cfd-a1b5-49b5332c8c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:39.776707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da781b2-9d56-4cfd-a1b5-49b5332c8c6e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.776990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da781b2-9d56-4cfd-a1b5-49b5332c8c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.777260 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da781b2-9d56-4cfd-a1b5-49b5332c8c6e None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.778017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da781b2-9d56-4cfd-a1b5-49b5332c8c6e None admin] RBAC: Adding query filter params (type=network) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:39.778420 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da781b2-9d56-4cfd-a1b5-49b5332c8c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:39.779793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da781b2-9d56-4cfd-a1b5-49b5332c8c6e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:39.791235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 403/776] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:29:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:39.791913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da781b2-9d56-4cfd-a1b5-49b5332c8c6e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:39.832685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:39.870394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f25dd-f803-43cb-92cd-e71d147fc6c6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:39.900321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da781b2-9d56-4cfd-a1b5-49b5332c8c6e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:39.907525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecf1b5-8067-45ca-8d25-7a72a907a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:39.908926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecf1b5-8067-45ca-8d25-7a72a907a8ca None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.909351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecf1b5-8067-45ca-8d25-7a72a907a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.909765 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ecf1b5-8067-45ca-8d25-7a72a907a8ca None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.910729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecf1b5-8067-45ca-8d25-7a72a907a8ca None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:39.911191 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecf1b5-8067-45ca-8d25-7a72a907a8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:39.912813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ecf1b5-8067-45ca-8d25-7a72a907a8ca None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:39.918103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 374/777] 10.222.0.79 () {56 vars in 1124 bytes} [Wed May 25 14:29:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:39.919148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecf1b5-8067-45ca-8d25-7a72a907a8ca None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:39.935608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:39.936617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e874d4-4ea1-43ef-99d3-87a9a22fccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:39.937412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e874d4-4ea1-43ef-99d3-87a9a22fccc8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:39.937749 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e874d4-4ea1-43ef-99d3-87a9a22fccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:39.938075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e874d4-4ea1-43ef-99d3-87a9a22fccc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:39.949543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e874d4-4ea1-43ef-99d3-87a9a22fccc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-79e874d4-4ea1-43ef-99d3-87a9a22fccc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:39.957569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:39.958622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:39.959423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:39.963637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 404/778] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:39.964519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e874d4-4ea1-43ef-99d3-87a9a22fccc8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:40.032602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ecf1b5-8067-45ca-8d25-7a72a907a8ca None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:40.062956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:40.070896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e874d4-4ea1-43ef-99d3-87a9a22fccc8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:40.073247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fbe5a-09f0-46c5-9d07-d282fd6a8885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:40.073918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fbe5a-09f0-46c5-9d07-d282fd6a8885 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:40.074236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fbe5a-09f0-46c5-9d07-d282fd6a8885 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:40.074512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900fbe5a-09f0-46c5-9d07-d282fd6a8885 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:40.075304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fbe5a-09f0-46c5-9d07-d282fd6a8885 None admin] RBAC: Adding query filter params (interface=public, service_id=4b87a9c0b9c74e0e9c7f01cf27d80fbd, region_id=RegionOne) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:40.075617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fbe5a-09f0-46c5-9d07-d282fd6a8885 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:40.076990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900fbe5a-09f0-46c5-9d07-d282fd6a8885 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:40.085561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 375/779] 10.222.0.79 () {56 vars in 1251 bytes} [Wed May 25 14:29:39 2022] GET /identity/v3/endpoints?service_id=4b87a9c0b9c74e0e9c7f01cf27d80fbd&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:40.086484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fbe5a-09f0-46c5-9d07-d282fd6a8885 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:40.109500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37d812-7b7f-4b77-8ff8-e9ebb35d85ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:40.110143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d812-7b7f-4b77-8ff8-e9ebb35d85ff None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:40.110429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d812-7b7f-4b77-8ff8-e9ebb35d85ff None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:40.110750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37d812-7b7f-4b77-8ff8-e9ebb35d85ff None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:40.112055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37d812-7b7f-4b77-8ff8-e9ebb35d85ff None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:40.112416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37d812-7b7f-4b77-8ff8-e9ebb35d85ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:40.113784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c37d812-7b7f-4b77-8ff8-e9ebb35d85ff None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:40.119251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 405/780] 10.222.0.79 () {56 vars in 1124 bytes} [Wed May 25 14:29:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:40.120086 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37d812-7b7f-4b77-8ff8-e9ebb35d85ff None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:40.174643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:40.199604 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900fbe5a-09f0-46c5-9d07-d282fd6a8885 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:40.232797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c37d812-7b7f-4b77-8ff8-e9ebb35d85ff None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:40.234540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a9592-1d31-4166-be5d-4d99f944644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:40.235311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9592-1d31-4166-be5d-4d99f944644d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:40.235599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9592-1d31-4166-be5d-4d99f944644d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:40.235876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a9592-1d31-4166-be5d-4d99f944644d None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:40.237263 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a9592-1d31-4166-be5d-4d99f944644d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:40.237571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a9592-1d31-4166-be5d-4d99f944644d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:40.238975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a9592-1d31-4166-be5d-4d99f944644d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:40.247980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 376/781] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:40.248995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a9592-1d31-4166-be5d-4d99f944644d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:40.277463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f0066-d127-45b7-b3df-f272dece684e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:40.278250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f0066-d127-45b7-b3df-f272dece684e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:40.278528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f0066-d127-45b7-b3df-f272dece684e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:40.278802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f0066-d127-45b7-b3df-f272dece684e None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:40.279517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f0066-d127-45b7-b3df-f272dece684e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:40.280945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f0066-d127-45b7-b3df-f272dece684e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:40.294536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 406/782] 10.222.0.79 () {56 vars in 1087 bytes} [Wed May 25 14:29:40 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:40.295576 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f0066-d127-45b7-b3df-f272dece684e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:40.337970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:40.364790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a9592-1d31-4166-be5d-4d99f944644d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:40.403913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ae9ad-e882-4cf9-a307-c0d48e9eba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:40.404677 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ae9ad-e882-4cf9-a307-c0d48e9eba0a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:40.404963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ae9ad-e882-4cf9-a307-c0d48e9eba0a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:40.405236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856ae9ad-e882-4cf9-a307-c0d48e9eba0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:40.406032 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ae9ad-e882-4cf9-a307-c0d48e9eba0a None admin] RBAC: Adding query filter params (interface=public, service_id=9622e323b67c48beb981b65b79446759, region_id=RegionOne) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:40.406371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ae9ad-e882-4cf9-a307-c0d48e9eba0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:40.407761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856ae9ad-e882-4cf9-a307-c0d48e9eba0a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:40.413803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 377/783] 10.222.0.79 () {56 vars in 1251 bytes} [Wed May 25 14:29:40 2022] GET /identity/v3/endpoints?service_id=9622e323b67c48beb981b65b79446759&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:40.419159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ae9ad-e882-4cf9-a307-c0d48e9eba0a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:40.421817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:40.461438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f0066-d127-45b7-b3df-f272dece684e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:40.497452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2f9be-fd0f-407f-b7bf-4d6be061b8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:40.498325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2f9be-fd0f-407f-b7bf-4d6be061b8fd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:40.498605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2f9be-fd0f-407f-b7bf-4d6be061b8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:40.498876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2f9be-fd0f-407f-b7bf-4d6be061b8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:40.511798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2f9be-fd0f-407f-b7bf-4d6be061b8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:40.513290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2f9be-fd0f-407f-b7bf-4d6be061b8fd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-31b2f9be-fd0f-407f-b7bf-4d6be061b8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:40.533609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:40.535704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:40.537808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:40.537808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:40.537808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:40.537808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:40.538350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856ae9ad-e882-4cf9-a307-c0d48e9eba0a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:40.538512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 407/784] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:40.542106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2f9be-fd0f-407f-b7bf-4d6be061b8fd None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:40.572417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bf8fe-33ea-4900-aeb4-b9e36c550bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:40.573098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bf8fe-33ea-4900-aeb4-b9e36c550bec None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:40.573379 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bf8fe-33ea-4900-aeb4-b9e36c550bec None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:40.573659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bf8fe-33ea-4900-aeb4-b9e36c550bec None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:40.574466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bf8fe-33ea-4900-aeb4-b9e36c550bec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:40.575959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bf8fe-33ea-4900-aeb4-b9e36c550bec None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:40.582668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 378/785] 10.222.0.79 () {56 vars in 1087 bytes} [Wed May 25 14:29:40 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:40.630405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:40.657866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2f9be-fd0f-407f-b7bf-4d6be061b8fd None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:40.696710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d969e6-a489-40af-9c66-7f6e094835ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:40.697380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d969e6-a489-40af-9c66-7f6e094835ed None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:40.697659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d969e6-a489-40af-9c66-7f6e094835ed None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:40.697931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d969e6-a489-40af-9c66-7f6e094835ed None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:40.698698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d969e6-a489-40af-9c66-7f6e094835ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:40.699001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d969e6-a489-40af-9c66-7f6e094835ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:40.700393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d969e6-a489-40af-9c66-7f6e094835ed None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:40.715235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 408/786] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:40.720910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bf8fe-33ea-4900-aeb4-b9e36c550bec None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:40.801848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:40.847622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bf8fe-33ea-4900-aeb4-b9e36c550bec None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:40.888340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3c9ff-069a-494d-bfc4-9bf082ce19d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:40.889104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c9ff-069a-494d-bfc4-9bf082ce19d9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:40.889391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c9ff-069a-494d-bfc4-9bf082ce19d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:40.889663 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c9ff-069a-494d-bfc4-9bf082ce19d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:40.898329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3c9ff-069a-494d-bfc4-9bf082ce19d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:40.899761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d3c9ff-069a-494d-bfc4-9bf082ce19d9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-b8d3c9ff-069a-494d-bfc4-9bf082ce19d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:40.915874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:40.916824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:40.917731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 379/787] 10.222.0.79 () {56 vars in 1093 bytes} [Wed May 25 14:29:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:40.922861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d969e6-a489-40af-9c66-7f6e094835ed None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:41.049568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d969e6-a489-40af-9c66-7f6e094835ed None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:41.090813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2dc6a2-3ed6-401c-aef5-7ad8f39a2ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:41.091590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dc6a2-3ed6-401c-aef5-7ad8f39a2ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:41.091756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dc6a2-3ed6-401c-aef5-7ad8f39a2ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:41.092035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2dc6a2-3ed6-401c-aef5-7ad8f39a2ed6 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:41.092876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2dc6a2-3ed6-401c-aef5-7ad8f39a2ed6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:41.093182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2dc6a2-3ed6-401c-aef5-7ad8f39a2ed6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:41.094637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2dc6a2-3ed6-401c-aef5-7ad8f39a2ed6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:41.103238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:41.120383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 409/788] 10.222.0.79 () {56 vars in 1133 bytes} [Wed May 25 14:29:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:41.126017 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3c9ff-069a-494d-bfc4-9bf082ce19d9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:41.253688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d3c9ff-069a-494d-bfc4-9bf082ce19d9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:41.282178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:41.291945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0338f17-51d3-4a4c-99ef-f0d42f123303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:41.292895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0338f17-51d3-4a4c-99ef-f0d42f123303 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:41.293382 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0338f17-51d3-4a4c-99ef-f0d42f123303 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:41.293872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0338f17-51d3-4a4c-99ef-f0d42f123303 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:41.383140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0338f17-51d3-4a4c-99ef-f0d42f123303 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:41.384613 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0338f17-51d3-4a4c-99ef-f0d42f123303 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:41.518210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 380/789] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:41.523809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2dc6a2-3ed6-401c-aef5-7ad8f39a2ed6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:41.668202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2dc6a2-3ed6-401c-aef5-7ad8f39a2ed6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:41.716635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f41fc6-104e-4f73-b8d6-6e428eb82315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:41.717438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f41fc6-104e-4f73-b8d6-6e428eb82315 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:41.717718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f41fc6-104e-4f73-b8d6-6e428eb82315 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:41.717990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f41fc6-104e-4f73-b8d6-6e428eb82315 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:41.728535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f41fc6-104e-4f73-b8d6-6e428eb82315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:41.730045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f41fc6-104e-4f73-b8d6-6e428eb82315 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-88f41fc6-104e-4f73-b8d6-6e428eb82315 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:41.748294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:41.749152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:41.750018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:41.750018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:41.750018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:41.750018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:41.750018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 410/790] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:41.755056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0338f17-51d3-4a4c-99ef-f0d42f123303 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:41.786006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6379f03-baff-4f3a-994b-ace50e207039 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:41.786298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6379f03-baff-4f3a-994b-ace50e207039 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:41.786559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6379f03-baff-4f3a-994b-ace50e207039 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:41.788174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 411/791] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:29:41.794928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14293-2f02-4d0b-9bd2-836b97ef8267 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:41.795208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14293-2f02-4d0b-9bd2-836b97ef8267 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:41.795484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f14293-2f02-4d0b-9bd2-836b97ef8267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:41.818466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:41.823994 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a8f14293-2f02-4d0b-9bd2-836b97ef8267 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:41.825230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a8f14293-2f02-4d0b-9bd2-836b97ef8267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:41.917907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:41.951851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0338f17-51d3-4a4c-99ef-f0d42f123303 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:41.966708 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 412/792] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:41.989824 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14293-2f02-4d0b-9bd2-836b97ef8267 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.021914 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf6ff8-0835-4758-a0c0-7a78df2df416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.022662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf6ff8-0835-4758-a0c0-7a78df2df416 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.022947 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf6ff8-0835-4758-a0c0-7a78df2df416 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.023221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cf6ff8-0835-4758-a0c0-7a78df2df416 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.023951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf6ff8-0835-4758-a0c0-7a78df2df416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:42.024254 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf6ff8-0835-4758-a0c0-7a78df2df416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:42.025631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cf6ff8-0835-4758-a0c0-7a78df2df416 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:42.043062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 381/793] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:42.050780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf6ff8-0835-4758-a0c0-7a78df2df416 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.121169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f14293-2f02-4d0b-9bd2-836b97ef8267 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:42.149024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:42.161981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d39be-f544-4455-948e-35eb6ca14c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.163134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d39be-f544-4455-948e-35eb6ca14c41 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.163592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d39be-f544-4455-948e-35eb6ca14c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.164079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d39be-f544-4455-948e-35eb6ca14c41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.164973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cf6ff8-0835-4758-a0c0-7a78df2df416 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:42.175765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d39be-f544-4455-948e-35eb6ca14c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-612d39be-f544-4455-948e-35eb6ca14c41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:42.184447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:42.185361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:42.186213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:42.193654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 413/794] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:42.195369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1acf-dbb7-458c-98ee-c059a3bf4daa None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.195857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1acf-dbb7-458c-98ee-c059a3bf4daa None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.196357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad1acf-dbb7-458c-98ee-c059a3bf4daa None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.198072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 414/795] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:42.198982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad1acf-dbb7-458c-98ee-c059a3bf4daa None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.203432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f4052-456b-421a-8654-4bd0bea644f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.203432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f4052-456b-421a-8654-4bd0bea644f5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.203432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f4052-456b-421a-8654-4bd0bea644f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.203432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f4052-456b-421a-8654-4bd0bea644f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.209441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f4052-456b-421a-8654-4bd0bea644f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:42.210906 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f4052-456b-421a-8654-4bd0bea644f5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-ae7f4052-456b-421a-8654-4bd0bea644f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:42.225959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:42.226887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:42.227760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:42.227760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:42.227760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:42.227760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:42.227760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:42.227760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:42.227760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:42.227760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:42.231888 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 382/796] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:42.233148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69604d18-5710-48f0-982f-334db45efe71 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.233438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69604d18-5710-48f0-982f-334db45efe71 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.233719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69604d18-5710-48f0-982f-334db45efe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.251643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:42.252491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-69604d18-5710-48f0-982f-334db45efe71 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:42.253864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-69604d18-5710-48f0-982f-334db45efe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:42.331281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad1acf-dbb7-458c-98ee-c059a3bf4daa None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:42.331450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 383/797] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:42.332194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69604d18-5710-48f0-982f-334db45efe71 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.369396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6a7b8-403b-46d6-a5ca-7e5efe797973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.370042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6a7b8-403b-46d6-a5ca-7e5efe797973 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.370355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6a7b8-403b-46d6-a5ca-7e5efe797973 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.370631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6a7b8-403b-46d6-a5ca-7e5efe797973 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.371373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6a7b8-403b-46d6-a5ca-7e5efe797973 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:42.371689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6a7b8-403b-46d6-a5ca-7e5efe797973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:42.373046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f6a7b8-403b-46d6-a5ca-7e5efe797973 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:42.381429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 415/798] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:42.385502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6a7b8-403b-46d6-a5ca-7e5efe797973 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.440251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:42.465514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69604d18-5710-48f0-982f-334db45efe71 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:42.487415 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:42.491207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6a7b8-403b-46d6-a5ca-7e5efe797973 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:42.504398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8633a3f-59ea-4fbd-af0a-e81e1b104341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.505351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8633a3f-59ea-4fbd-af0a-e81e1b104341 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.505877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8633a3f-59ea-4fbd-af0a-e81e1b104341 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.506461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8633a3f-59ea-4fbd-af0a-e81e1b104341 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.507466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8633a3f-59ea-4fbd-af0a-e81e1b104341 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:42.507969 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8633a3f-59ea-4fbd-af0a-e81e1b104341 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:42.509764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8633a3f-59ea-4fbd-af0a-e81e1b104341 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:42.528274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 384/799] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:42.528570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363b74e-4e8d-48bd-a11d-4bcd257bbe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.529363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363b74e-4e8d-48bd-a11d-4bcd257bbe40 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.529646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363b74e-4e8d-48bd-a11d-4bcd257bbe40 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.529922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363b74e-4e8d-48bd-a11d-4bcd257bbe40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.530425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8633a3f-59ea-4fbd-af0a-e81e1b104341 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.541693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7363b74e-4e8d-48bd-a11d-4bcd257bbe40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-7363b74e-4e8d-48bd-a11d-4bcd257bbe40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:42.550428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:42.551623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:42.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:42.555110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 416/800] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:42.556115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363b74e-4e8d-48bd-a11d-4bcd257bbe40 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.661531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8633a3f-59ea-4fbd-af0a-e81e1b104341 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:42.670296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363b74e-4e8d-48bd-a11d-4bcd257bbe40 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:42.706110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2601361-fe0c-48df-872f-17167086d8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.706964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2601361-fe0c-48df-872f-17167086d8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.707340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2601361-fe0c-48df-872f-17167086d8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.707581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90737f-17d1-4cb7-ae2a-7575d822b1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.707803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2601361-fe0c-48df-872f-17167086d8c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.708700 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90737f-17d1-4cb7-ae2a-7575d822b1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.708815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2601361-fe0c-48df-872f-17167086d8c2 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=eb66b6f6b5524f3687411fa83d525acc) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:42.709207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2601361-fe0c-48df-872f-17167086d8c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:42.709345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90737f-17d1-4cb7-ae2a-7575d822b1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.709758 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90737f-17d1-4cb7-ae2a-7575d822b1a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.710922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2601361-fe0c-48df-872f-17167086d8c2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:42.713276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:42.723738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90737f-17d1-4cb7-ae2a-7575d822b1a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:42.724834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 417/801] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:42 2022] GET /identity/v3/role_assignments?user.id=eb66b6f6b5524f3687411fa83d525acc&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=308d9785120a49079e02659953a2b033 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:42.725850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2601361-fe0c-48df-872f-17167086d8c2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.726203 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90737f-17d1-4cb7-ae2a-7575d822b1a9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-3a90737f-17d1-4cb7-ae2a-7575d822b1a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:42.748323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:42.749258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:42.750163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:42.750163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:42.750163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:42.750163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:42.752919 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 385/802] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:42.770809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:42.773765 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90737f-17d1-4cb7-ae2a-7575d822b1a9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:42.862264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2601361-fe0c-48df-872f-17167086d8c2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:42.900023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c44d0-4ab9-4f1f-ba85-b8b338c2107f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:42.900697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c44d0-4ab9-4f1f-ba85-b8b338c2107f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:42.900976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c44d0-4ab9-4f1f-ba85-b8b338c2107f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:42.901248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c44d0-4ab9-4f1f-ba85-b8b338c2107f None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:42.902071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c44d0-4ab9-4f1f-ba85-b8b338c2107f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:42.902418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c44d0-4ab9-4f1f-ba85-b8b338c2107f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:42.903991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c44d0-4ab9-4f1f-ba85-b8b338c2107f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:42.915543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 418/803] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:42.921738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c44d0-4ab9-4f1f-ba85-b8b338c2107f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:43.019820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:43.038016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c44d0-4ab9-4f1f-ba85-b8b338c2107f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:43.042669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90737f-17d1-4cb7-ae2a-7575d822b1a9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:43.080346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeff4f2-ef96-4857-935c-b5f630e2e7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:43.081323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeff4f2-ef96-4857-935c-b5f630e2e7ff None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.081653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeff4f2-ef96-4857-935c-b5f630e2e7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.081933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aeff4f2-ef96-4857-935c-b5f630e2e7ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.087632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b145b1-4320-4929-912a-3342ff7d1bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:43.088327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b145b1-4320-4929-912a-3342ff7d1bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.088608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b145b1-4320-4929-912a-3342ff7d1bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.088883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b145b1-4320-4929-912a-3342ff7d1bf7 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.089632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b145b1-4320-4929-912a-3342ff7d1bf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:43.089941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b145b1-4320-4929-912a-3342ff7d1bf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:43.092220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b145b1-4320-4929-912a-3342ff7d1bf7 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:43.095904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeff4f2-ef96-4857-935c-b5f630e2e7ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:43.097448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aeff4f2-ef96-4857-935c-b5f630e2e7ff None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:43.107995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 386/804] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:43.114495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b145b1-4320-4929-912a-3342ff7d1bf7 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2aeff4f2-ef96-4857-935c-b5f630e2e7ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:43.123647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:43.125999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:43.128258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:43.128258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:43.128258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:43.128258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:43.128258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 419/805] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:43.136423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeff4f2-ef96-4857-935c-b5f630e2e7ff None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:43.177261 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:43.241267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b145b1-4320-4929-912a-3342ff7d1bf7 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:43.273812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aeff4f2-ef96-4857-935c-b5f630e2e7ff None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:43.276991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac991a01-4ac3-4ccc-8fff-da3f12bd94bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:43.277944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991a01-4ac3-4ccc-8fff-da3f12bd94bf None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.278407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991a01-4ac3-4ccc-8fff-da3f12bd94bf None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.278776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac991a01-4ac3-4ccc-8fff-da3f12bd94bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.286931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac991a01-4ac3-4ccc-8fff-da3f12bd94bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:43.288617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac991a01-4ac3-4ccc-8fff-da3f12bd94bf None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-ac991a01-4ac3-4ccc-8fff-da3f12bd94bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:43.305332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:43.306372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:43.307309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 387/806] 10.222.0.79 () {56 vars in 1117 bytes} [Wed May 25 14:29:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:43.307883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1ac07-7eda-4dac-bbba-e304136c05cb None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.308295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1ac07-7eda-4dac-bbba-e304136c05cb None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.308389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e1ac07-7eda-4dac-bbba-e304136c05cb None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.310749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 388/807] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:43.310853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed5333-eeb5-4bd5-a52b-4cfdaa4f6e00 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.311362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed5333-eeb5-4bd5-a52b-4cfdaa4f6e00 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.311903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed5333-eeb5-4bd5-a52b-4cfdaa4f6e00 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.312908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 389/808] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:43.313593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed5333-eeb5-4bd5-a52b-4cfdaa4f6e00 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:43.318811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25999ea5-8349-485b-b14f-fc7fc1fd3c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:43.319456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25999ea5-8349-485b-b14f-fc7fc1fd3c7d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.319727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25999ea5-8349-485b-b14f-fc7fc1fd3c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.319994 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25999ea5-8349-485b-b14f-fc7fc1fd3c7d None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.320707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25999ea5-8349-485b-b14f-fc7fc1fd3c7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:43.321009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25999ea5-8349-485b-b14f-fc7fc1fd3c7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:43.323338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25999ea5-8349-485b-b14f-fc7fc1fd3c7d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:43.325878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:43.338657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 420/809] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:43.340180 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8d7bf-08f3-4dca-89a6-cdb9a17962b4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.340676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8d7bf-08f3-4dca-89a6-cdb9a17962b4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.341142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb8d7bf-08f3-4dca-89a6-cdb9a17962b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.357977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4cb8d7bf-08f3-4dca-89a6-cdb9a17962b4 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:43.359190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4cb8d7bf-08f3-4dca-89a6-cdb9a17962b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:43.428734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed5333-eeb5-4bd5-a52b-4cfdaa4f6e00 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:43.431534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 421/810] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:43.432300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d33db-4da6-4c05-8cbc-f695f4f7def2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.432590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d33db-4da6-4c05-8cbc-f695f4f7def2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.432861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8d33db-4da6-4c05-8cbc-f695f4f7def2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.449305 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6e8d33db-4da6-4c05-8cbc-f695f4f7def2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:43.450422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:43.450534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6e8d33db-4da6-4c05-8cbc-f695f4f7def2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:43.477805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac52c2-788f-4976-8afb-d0e23648127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:43.478499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac52c2-788f-4976-8afb-d0e23648127a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.478782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac52c2-788f-4976-8afb-d0e23648127a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.479146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac52c2-788f-4976-8afb-d0e23648127a None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.479888 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac52c2-788f-4976-8afb-d0e23648127a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:43.480197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac52c2-788f-4976-8afb-d0e23648127a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:43.481626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac52c2-788f-4976-8afb-d0e23648127a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:43.504218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 390/811] 10.222.0.79 () {56 vars in 1149 bytes} [Wed May 25 14:29:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:43.504218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac52c2-788f-4976-8afb-d0e23648127a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:43.530450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 422/812] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:43.531303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d33db-4da6-4c05-8cbc-f695f4f7def2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:43.603593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:43.609087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac52c2-788f-4976-8afb-d0e23648127a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:43.645356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27849724-f530-40ae-8b64-f3680cf22edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:43.646277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27849724-f530-40ae-8b64-f3680cf22edb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.646461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27849724-f530-40ae-8b64-f3680cf22edb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.646739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27849724-f530-40ae-8b64-f3680cf22edb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.653402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8d33db-4da6-4c05-8cbc-f695f4f7def2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:43.653945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27849724-f530-40ae-8b64-f3680cf22edb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:43.655411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27849724-f530-40ae-8b64-f3680cf22edb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-27849724-f530-40ae-8b64-f3680cf22edb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:43.671181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:43.672243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:43.673178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 391/813] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:43.674466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27849724-f530-40ae-8b64-f3680cf22edb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:43.696555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515b840-af74-4499-8ded-e2a6ff01a114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:43.697447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515b840-af74-4499-8ded-e2a6ff01a114 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.697559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515b840-af74-4499-8ded-e2a6ff01a114 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.697835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515b840-af74-4499-8ded-e2a6ff01a114 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.698526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515b840-af74-4499-8ded-e2a6ff01a114 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:43.699906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515b840-af74-4499-8ded-e2a6ff01a114 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:43.703384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0515b840-af74-4499-8ded-e2a6ff01a114 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:43.713170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:43.714353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 14:29:43.715194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:43.719665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 423/814] 10.222.0.79 () {56 vars in 1129 bytes} [Wed May 25 14:29:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:43.719918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515b840-af74-4499-8ded-e2a6ff01a114 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:43.782601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27849724-f530-40ae-8b64-f3680cf22edb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:43.818055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a1f9-42de-46e7-bb71-318258542c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:43.818881 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a1f9-42de-46e7-bb71-318258542c88 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.819162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a1f9-42de-46e7-bb71-318258542c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.819441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40a1f9-42de-46e7-bb71-318258542c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.824461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515b840-af74-4499-8ded-e2a6ff01a114 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:43.829872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40a1f9-42de-46e7-bb71-318258542c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:43.831384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40a1f9-42de-46e7-bb71-318258542c88 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:43.847803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-ea40a1f9-42de-46e7-bb71-318258542c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:43.855123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:43.856000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:43.856890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:43.856890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:43.856890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:43.856890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:43.860895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 392/815] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:43.862325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a1f9-42de-46e7-bb71-318258542c88 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:43.869524 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d416497-8233-4509-8691-f2034a9e719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:43.870678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d416497-8233-4509-8691-f2034a9e719a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:43.870959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d416497-8233-4509-8691-f2034a9e719a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:43.871234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d416497-8233-4509-8691-f2034a9e719a None admin] PATH_INFO: `/v3/services/network` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:43.871875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d416497-8233-4509-8691-f2034a9e719a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:43.873366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d416497-8233-4509-8691-f2034a9e719a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-7d416497-8233-4509-8691-f2034a9e719a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:43.885927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:43.886927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:43.887782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 424/816] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:43 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:43.888579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d416497-8233-4509-8691-f2034a9e719a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:43.946329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:43.968526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40a1f9-42de-46e7-bb71-318258542c88 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:43.994156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d416497-8233-4509-8691-f2034a9e719a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.003194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16a19-7922-44d4-bda7-9c53324282ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.003962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16a19-7922-44d4-bda7-9c53324282ad None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.004343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16a19-7922-44d4-bda7-9c53324282ad None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.004718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a16a19-7922-44d4-bda7-9c53324282ad None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.005650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a16a19-7922-44d4-bda7-9c53324282ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:44.006024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a16a19-7922-44d4-bda7-9c53324282ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.007531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a16a19-7922-44d4-bda7-9c53324282ad None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.026123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 393/817] 10.222.0.79 () {56 vars in 1135 bytes} [Wed May 25 14:29:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:44.026911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16a19-7922-44d4-bda7-9c53324282ad None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.033822 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeda05-f53d-465a-b59e-8624b0520eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.035315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeda05-f53d-465a-b59e-8624b0520eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.035601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeda05-f53d-465a-b59e-8624b0520eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.035878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfeda05-f53d-465a-b59e-8624b0520eb8 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.036586 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeda05-f53d-465a-b59e-8624b0520eb8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:44.036893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeda05-f53d-465a-b59e-8624b0520eb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.038299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfeda05-f53d-465a-b59e-8624b0520eb8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.043858 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 425/818] 10.222.0.79 () {56 vars in 1124 bytes} [Wed May 25 14:29:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:44.044645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeda05-f53d-465a-b59e-8624b0520eb8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.100158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:44.140698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a16a19-7922-44d4-bda7-9c53324282ad None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.157340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfeda05-f53d-465a-b59e-8624b0520eb8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.179714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fecc85-de14-4383-b22d-59e96ea0cb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.180527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fecc85-de14-4383-b22d-59e96ea0cb69 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.180795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fecc85-de14-4383-b22d-59e96ea0cb69 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.181067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fecc85-de14-4383-b22d-59e96ea0cb69 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.181782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fecc85-de14-4383-b22d-59e96ea0cb69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:44.182097 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fecc85-de14-4383-b22d-59e96ea0cb69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.183528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fecc85-de14-4383-b22d-59e96ea0cb69 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.185968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:44.195256 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417a2e6-2ce0-486e-8274-eb65472cff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.195969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a2e6-2ce0-486e-8274-eb65472cff72 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.200484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a2e6-2ce0-486e-8274-eb65472cff72 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.200609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 394/819] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:44.200687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417a2e6-2ce0-486e-8274-eb65472cff72 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.200687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417a2e6-2ce0-486e-8274-eb65472cff72 None admin] RBAC: Adding query filter params (name=network) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:44.200842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fecc85-de14-4383-b22d-59e96ea0cb69 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.200921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417a2e6-2ce0-486e-8274-eb65472cff72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.200921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417a2e6-2ce0-486e-8274-eb65472cff72 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.204340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 426/820] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:29:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:44.205388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417a2e6-2ce0-486e-8274-eb65472cff72 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.312007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fecc85-de14-4383-b22d-59e96ea0cb69 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.312318 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417a2e6-2ce0-486e-8274-eb65472cff72 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.326215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:44.349740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21967c9d-7d72-4314-9865-41ba8d19f290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.350661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967c9d-7d72-4314-9865-41ba8d19f290 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.350919 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66fff-1a12-48a2-8292-ecefe8e39bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.351253 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967c9d-7d72-4314-9865-41ba8d19f290 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.351668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21967c9d-7d72-4314-9865-41ba8d19f290 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.351779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66fff-1a12-48a2-8292-ecefe8e39bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.351972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66fff-1a12-48a2-8292-ecefe8e39bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.352241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d66fff-1a12-48a2-8292-ecefe8e39bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.352900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21967c9d-7d72-4314-9865-41ba8d19f290 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:44.353335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21967c9d-7d72-4314-9865-41ba8d19f290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.354875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21967c9d-7d72-4314-9865-41ba8d19f290 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.359766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 427/821] 10.222.0.79 () {56 vars in 1124 bytes} [Wed May 25 14:29:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:44.360536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21967c9d-7d72-4314-9865-41ba8d19f290 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.367211 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d66fff-1a12-48a2-8292-ecefe8e39bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.368666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d66fff-1a12-48a2-8292-ecefe8e39bc4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-75d66fff-1a12-48a2-8292-ecefe8e39bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:44.385651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:44.386562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:44.387452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:44.387452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:44.387452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:44.387452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:44.387452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 395/822] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:44.387718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66fff-1a12-48a2-8292-ecefe8e39bc4 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.438991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:44.472167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21967c9d-7d72-4314-9865-41ba8d19f290 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.496822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d66fff-1a12-48a2-8292-ecefe8e39bc4 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.506599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac0b39-493b-4385-bcc8-8b9c5d3b3ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.507383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac0b39-493b-4385-bcc8-8b9c5d3b3ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.507660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac0b39-493b-4385-bcc8-8b9c5d3b3ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.507930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac0b39-493b-4385-bcc8-8b9c5d3b3ce5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.515453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac0b39-493b-4385-bcc8-8b9c5d3b3ce5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.516898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac0b39-493b-4385-bcc8-8b9c5d3b3ce5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-8fac0b39-493b-4385-bcc8-8b9c5d3b3ce5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:44.533934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:44.534970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:44.535820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:44.535820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:44.535820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:44.535820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:44.535820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:44.535820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:44.535820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:44.535820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:44.536238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20321e-27c2-4c4a-896f-ffb13dec397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.536238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20321e-27c2-4c4a-896f-ffb13dec397f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.536238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20321e-27c2-4c4a-896f-ffb13dec397f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.536238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20321e-27c2-4c4a-896f-ffb13dec397f None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.536508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20321e-27c2-4c4a-896f-ffb13dec397f None admin] RBAC: Adding query filter params (type=network) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:44.536508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20321e-27c2-4c4a-896f-ffb13dec397f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.537505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20321e-27c2-4c4a-896f-ffb13dec397f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.540093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 428/823] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:44.540771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac0b39-493b-4385-bcc8-8b9c5d3b3ce5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.547129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 396/824] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:29:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:44.547129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20321e-27c2-4c4a-896f-ffb13dec397f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.581230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:44.649225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac0b39-493b-4385-bcc8-8b9c5d3b3ce5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.651877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20321e-27c2-4c4a-896f-ffb13dec397f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.665073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:44.687268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d638932-dcee-4868-8107-8be0d8848c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.687656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d15329-aaed-4f6c-b4a4-213161521703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.687924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d638932-dcee-4868-8107-8be0d8848c9c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.688204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d638932-dcee-4868-8107-8be0d8848c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.688477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d638932-dcee-4868-8107-8be0d8848c9c None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.688707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d15329-aaed-4f6c-b4a4-213161521703 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.689077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d15329-aaed-4f6c-b4a4-213161521703 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.689244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d638932-dcee-4868-8107-8be0d8848c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:44.689548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d638932-dcee-4868-8107-8be0d8848c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.689638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d15329-aaed-4f6c-b4a4-213161521703 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.690593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d15329-aaed-4f6c-b4a4-213161521703 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.690942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d638932-dcee-4868-8107-8be0d8848c9c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.692146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d15329-aaed-4f6c-b4a4-213161521703 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.703264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 397/825] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:44.704312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d638932-dcee-4868-8107-8be0d8848c9c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.722242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 429/826] 10.222.0.79 () {60 vars in 1144 bytes} [Wed May 25 14:29:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:44.722242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d15329-aaed-4f6c-b4a4-213161521703 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.834796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:44.861104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d638932-dcee-4868-8107-8be0d8848c9c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.863855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d15329-aaed-4f6c-b4a4-213161521703 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:44.904126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78408d46-2fa9-4e3a-a740-8623f4941342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.904813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78408d46-2fa9-4e3a-a740-8623f4941342 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.905093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78408d46-2fa9-4e3a-a740-8623f4941342 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.905417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78408d46-2fa9-4e3a-a740-8623f4941342 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.906203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78408d46-2fa9-4e3a-a740-8623f4941342 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.907665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78408d46-2fa9-4e3a-a740-8623f4941342 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.913830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad4697-4842-40c5-8497-66a595fff439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:44.914536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad4697-4842-40c5-8497-66a595fff439 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:44.914816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad4697-4842-40c5-8497-66a595fff439 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:44.915088 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ad4697-4842-40c5-8497-66a595fff439 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:44.915887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad4697-4842-40c5-8497-66a595fff439 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:44.916194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad4697-4842-40c5-8497-66a595fff439 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:44.917622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ad4697-4842-40c5-8497-66a595fff439 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:44.930845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 430/827] 10.222.0.79 () {60 vars in 1144 bytes} [Wed May 25 14:29:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:44.932125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78408d46-2fa9-4e3a-a740-8623f4941342 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.936489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 398/828] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:44.944333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad4697-4842-40c5-8497-66a595fff439 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:44.986377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:45.066754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78408d46-2fa9-4e3a-a740-8623f4941342 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:45.074563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ad4697-4842-40c5-8497-66a595fff439 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:45.106104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae3779-36c2-45e9-905c-523960803798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:45.106833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae3779-36c2-45e9-905c-523960803798 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:45.107116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae3779-36c2-45e9-905c-523960803798 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:45.107419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae3779-36c2-45e9-905c-523960803798 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:45.116273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae3779-36c2-45e9-905c-523960803798 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:45.117784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae3779-36c2-45e9-905c-523960803798 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:45.121059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:45.123471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09caf96-0a9c-4773-a2ab-d450d9cb4780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:45.124733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09caf96-0a9c-4773-a2ab-d450d9cb4780 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:45.125211 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09caf96-0a9c-4773-a2ab-d450d9cb4780 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:45.125692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09caf96-0a9c-4773-a2ab-d450d9cb4780 None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/be474c0453a0403b8db884a89fe9e486/roles/f4c0968e3f8b4988a9f32d8ef25d481b` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-44ae3779-36c2-45e9-905c-523960803798 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:45.136821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:45.137868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:45.138778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:45.138778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:45.138778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:45.138778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:45.138778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:45.138778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:45.138778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:45.138778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:45.138778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 431/829] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:45.146263 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae3779-36c2-45e9-905c-523960803798 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:45.150130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09caf96-0a9c-4773-a2ab-d450d9cb4780 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=be474c0453a0403b8db884a89fe9e486, role_id=f4c0968e3f8b4988a9f32d8ef25d481b)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:45.151967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09caf96-0a9c-4773-a2ab-d450d9cb4780 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:45.169129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 399/830] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:29:44 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/be474c0453a0403b8db884a89fe9e486/roles/f4c0968e3f8b4988a9f32d8ef25d481b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:45.281677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae3779-36c2-45e9-905c-523960803798 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:45.300515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68033-6747-4a2b-b16c-3305d408e30f None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:45.301059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68033-6747-4a2b-b16c-3305d408e30f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:45.301059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f68033-6747-4a2b-b16c-3305d408e30f None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:45.302773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 400/831] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:45.312801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a88a8-d2ae-492f-9252-9a9d9a150743 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:45.313105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a88a8-d2ae-492f-9252-9a9d9a150743 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:45.313358 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a88a8-d2ae-492f-9252-9a9d9a150743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:45.328967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e34f0-841e-43a7-a52d-7d5abd18c868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:45.329641 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e34f0-841e-43a7-a52d-7d5abd18c868 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:45.329984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e34f0-841e-43a7-a52d-7d5abd18c868 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:45.330309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e34f0-841e-43a7-a52d-7d5abd18c868 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:45.331047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e34f0-841e-43a7-a52d-7d5abd18c868 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:45.331353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e34f0-841e-43a7-a52d-7d5abd18c868 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:45.332826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e34f0-841e-43a7-a52d-7d5abd18c868 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:45.334165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-421a88a8-d2ae-492f-9252-9a9d9a150743 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:45.335609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-421a88a8-d2ae-492f-9252-9a9d9a150743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:45.347404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 432/832] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:45.353366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e34f0-841e-43a7-a52d-7d5abd18c868 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:45.433480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:45.434247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 401/833] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:45.454299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a88a8-d2ae-492f-9252-9a9d9a150743 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:45.472055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:45.482231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e34f0-841e-43a7-a52d-7d5abd18c868 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:45.530660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c972-3930-40f4-856a-53afea9c6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:45.531549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c972-3930-40f4-856a-53afea9c6f65 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:45.532074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c972-3930-40f4-856a-53afea9c6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:45.532348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c972-3930-40f4-856a-53afea9c6f65 None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/fa04ddd7a6ce4bbabdfca31721b9c71d/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:45.535812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796c972-3930-40f4-856a-53afea9c6f65 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=fa04ddd7a6ce4bbabdfca31721b9c71d, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:45.537253 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796c972-3930-40f4-856a-53afea9c6f65 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:45.557555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 433/834] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:29:45 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/fa04ddd7a6ce4bbabdfca31721b9c71d/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:29:45.575640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a88a8-d2ae-492f-9252-9a9d9a150743 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:45.616541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8adce-5162-4529-8f93-9f05f68f4284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:45.617378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8adce-5162-4529-8f93-9f05f68f4284 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:45.617752 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8adce-5162-4529-8f93-9f05f68f4284 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:45.618037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc8adce-5162-4529-8f93-9f05f68f4284 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:45.618734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8adce-5162-4529-8f93-9f05f68f4284 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:45.620136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc8adce-5162-4529-8f93-9f05f68f4284 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-cbc8adce-5162-4529-8f93-9f05f68f4284 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:45.635588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:45.636615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:29:45.637440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:45.642319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 402/835] 10.222.0.79 () {56 vars in 1132 bytes} [Wed May 25 14:29:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:45.644331 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c972-3930-40f4-856a-53afea9c6f65 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:45.766061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c972-3930-40f4-856a-53afea9c6f65 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:45.789126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:45.808350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58097d98-f988-4e5c-90c3-1fedacbc396c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:45.809017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58097d98-f988-4e5c-90c3-1fedacbc396c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:45.809299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58097d98-f988-4e5c-90c3-1fedacbc396c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:45.809574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58097d98-f988-4e5c-90c3-1fedacbc396c None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:45.810309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58097d98-f988-4e5c-90c3-1fedacbc396c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:45.810616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58097d98-f988-4e5c-90c3-1fedacbc396c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:45.812000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58097d98-f988-4e5c-90c3-1fedacbc396c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:45.817262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 434/836] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:29:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:45.822743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8adce-5162-4529-8f93-9f05f68f4284 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:45.907311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:45.937447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc8adce-5162-4529-8f93-9f05f68f4284 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:45.972750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f18de5-1f28-421e-a7df-8621b21608ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:45.973408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f18de5-1f28-421e-a7df-8621b21608ec None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:45.973688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f18de5-1f28-421e-a7df-8621b21608ec None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:45.973959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f18de5-1f28-421e-a7df-8621b21608ec None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:45.974690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f18de5-1f28-421e-a7df-8621b21608ec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:45.974995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f18de5-1f28-421e-a7df-8621b21608ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:45.976352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f18de5-1f28-421e-a7df-8621b21608ec None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:45.981358 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 403/837] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:29:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:47.243043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28949f74-d594-4b2e-80eb-36a9a658cc01 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.243568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28949f74-d594-4b2e-80eb-36a9a658cc01 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.243568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28949f74-d594-4b2e-80eb-36a9a658cc01 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.245099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 435/838] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:47.250829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0469b-e56c-4823-b9c3-8bf770dcfb7b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.251710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0469b-e56c-4823-b9c3-8bf770dcfb7b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.252192 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a0469b-e56c-4823-b9c3-8bf770dcfb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.270243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c3a0469b-e56c-4823-b9c3-8bf770dcfb7b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:47.271802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c3a0469b-e56c-4823-b9c3-8bf770dcfb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:47.344885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 404/839] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:47.368693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28949f74-d594-4b2e-80eb-36a9a658cc01 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:47.479232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28949f74-d594-4b2e-80eb-36a9a658cc01 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:47.515429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e895fa-b44e-4dca-9d01-637e66298846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:47.516584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e895fa-b44e-4dca-9d01-637e66298846 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.517071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e895fa-b44e-4dca-9d01-637e66298846 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.518065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e895fa-b44e-4dca-9d01-637e66298846 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.518950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e895fa-b44e-4dca-9d01-637e66298846 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:47.520631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e895fa-b44e-4dca-9d01-637e66298846 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-73e895fa-b44e-4dca-9d01-637e66298846 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:47.534031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:47.535044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:29:47.535856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:47.542139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de3f37-550b-4bde-b91f-5c93dca644cc None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.542139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de3f37-550b-4bde-b91f-5c93dca644cc None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.542139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de3f37-550b-4bde-b91f-5c93dca644cc None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.542562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 436/840] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:47.543484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 405/841] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:47.547389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e895fa-b44e-4dca-9d01-637e66298846 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:47.548543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060e280-6762-4dd7-855e-49a33c4c5a7c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.548830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060e280-6762-4dd7-855e-49a33c4c5a7c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.549108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060e280-6762-4dd7-855e-49a33c4c5a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.566581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-b060e280-6762-4dd7-855e-49a33c4c5a7c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:47.567751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b060e280-6762-4dd7-855e-49a33c4c5a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:47.602579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:47.655034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:47.657256 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e895fa-b44e-4dca-9d01-637e66298846 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:47.666161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 406/842] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:47.686855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060e280-6762-4dd7-855e-49a33c4c5a7c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:47.703997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a64cf-9895-4ba6-9d79-9d1f8d7250be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:47.705750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a64cf-9895-4ba6-9d79-9d1f8d7250be None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.706053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a64cf-9895-4ba6-9d79-9d1f8d7250be None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.706764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a64cf-9895-4ba6-9d79-9d1f8d7250be None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.707850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a64cf-9895-4ba6-9d79-9d1f8d7250be None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:47.707850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a64cf-9895-4ba6-9d79-9d1f8d7250be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:47.708809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a64cf-9895-4ba6-9d79-9d1f8d7250be None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:47.720436 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 437/843] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:47.722905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a64cf-9895-4ba6-9d79-9d1f8d7250be None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:47.810274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060e280-6762-4dd7-855e-49a33c4c5a7c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:47.829384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a64cf-9895-4ba6-9d79-9d1f8d7250be None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:47.843801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:47.849627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a38bb-0805-4f9b-ba7a-ca557b1ba4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:47.850472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a38bb-0805-4f9b-ba7a-ca557b1ba4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.850753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a38bb-0805-4f9b-ba7a-ca557b1ba4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.851026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a38bb-0805-4f9b-ba7a-ca557b1ba4d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.865636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a38bb-0805-4f9b-ba7a-ca557b1ba4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:47.871791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998eeb86-9902-483f-9b68-cf2e37e144db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:47.872716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eeb86-9902-483f-9b68-cf2e37e144db None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.873218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eeb86-9902-483f-9b68-cf2e37e144db None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-d09a38bb-0805-4f9b-ba7a-ca557b1ba4d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:47.873625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:47.874539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:29:47.875377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:47.877239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998eeb86-9902-483f-9b68-cf2e37e144db None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.878197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eeb86-9902-483f-9b68-cf2e37e144db None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:47.878707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eeb86-9902-483f-9b68-cf2e37e144db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:47.880521 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 407/844] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:29:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:47.880820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998eeb86-9902-483f-9b68-cf2e37e144db None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:47.881580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a38bb-0805-4f9b-ba7a-ca557b1ba4d5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:47.893650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 438/845] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:47 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:47.893650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941d48-ea49-4372-9101-a936eebbbbbf None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.893650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941d48-ea49-4372-9101-a936eebbbbbf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.893650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92941d48-ea49-4372-9101-a936eebbbbbf None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.894519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 439/846] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:47.900124 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288ef7f-3e14-4078-a0aa-d0bcd026c727 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:47.900404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288ef7f-3e14-4078-a0aa-d0bcd026c727 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:47.900683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288ef7f-3e14-4078-a0aa-d0bcd026c727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:47.924467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2288ef7f-3e14-4078-a0aa-d0bcd026c727 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:47.925686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2288ef7f-3e14-4078-a0aa-d0bcd026c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:47.950438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:48.003854 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a38bb-0805-4f9b-ba7a-ca557b1ba4d5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.022269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 440/847] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:48.048178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288ef7f-3e14-4078-a0aa-d0bcd026c727 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.056585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe761-a712-4285-81c5-77196715afb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.057334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe761-a712-4285-81c5-77196715afb0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.057619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe761-a712-4285-81c5-77196715afb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.057894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fe761-a712-4285-81c5-77196715afb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.058722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fe761-a712-4285-81c5-77196715afb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:48.059029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fe761-a712-4285-81c5-77196715afb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:48.060645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fe761-a712-4285-81c5-77196715afb0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.071000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 408/848] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:29:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:48.076827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe761-a712-4285-81c5-77196715afb0 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.188382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288ef7f-3e14-4078-a0aa-d0bcd026c727 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.200847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:48.202592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fe761-a712-4285-81c5-77196715afb0 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.230519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:48.234645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f024bb-4f55-4e58-846b-9003ea529e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.235447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f024bb-4f55-4e58-846b-9003ea529e75 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.235733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f024bb-4f55-4e58-846b-9003ea529e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.236593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f024bb-4f55-4e58-846b-9003ea529e75 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.244850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2b7e7-dc98-4bf0-be96-ff3648fb41e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.245753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2b7e7-dc98-4bf0-be96-ff3648fb41e9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.246261 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2b7e7-dc98-4bf0-be96-ff3648fb41e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.246436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2b7e7-dc98-4bf0-be96-ff3648fb41e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.247896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f024bb-4f55-4e58-846b-9003ea529e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-27f024bb-4f55-4e58-846b-9003ea529e75 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:48.255793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:48.256733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:48.257560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 441/849] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:48.258841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b38749-134e-4a7c-a561-528258aa92b2 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.258841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b38749-134e-4a7c-a561-528258aa92b2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.258841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b38749-134e-4a7c-a561-528258aa92b2 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.260406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 442/850] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:48.262947 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b38749-134e-4a7c-a561-528258aa92b2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.264235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2b7e7-dc98-4bf0-be96-ff3648fb41e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:48.265504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a2b7e7-dc98-4bf0-be96-ff3648fb41e9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-81a2b7e7-dc98-4bf0-be96-ff3648fb41e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:48.284894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:48.285818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:48.286719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:48.286719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:48.286719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:48.286719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:48.286719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 409/851] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:48.287885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bc80-71b7-4759-95f6-7a65d5edfbb6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.288251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bc80-71b7-4759-95f6-7a65d5edfbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.288593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bc80-71b7-4759-95f6-7a65d5edfbb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.305759 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-86a1bc80-71b7-4759-95f6-7a65d5edfbb6 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:48.307059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-86a1bc80-71b7-4759-95f6-7a65d5edfbb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:48.380687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b38749-134e-4a7c-a561-528258aa92b2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.382134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 410/852] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:48.382411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bc80-71b7-4759-95f6-7a65d5edfbb6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.428545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d4a5-32b4-4e1c-b147-c4afb8c6e9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.429365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d4a5-32b4-4e1c-b147-c4afb8c6e9b8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.429649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d4a5-32b4-4e1c-b147-c4afb8c6e9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.429921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d4a5-32b4-4e1c-b147-c4afb8c6e9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.430696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d4a5-32b4-4e1c-b147-c4afb8c6e9b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:48.431002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d4a5-32b4-4e1c-b147-c4afb8c6e9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:48.432378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa4d4a5-32b4-4e1c-b147-c4afb8c6e9b8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.446465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 443/853] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:48.446465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d4a5-32b4-4e1c-b147-c4afb8c6e9b8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.473522 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:48.502790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bc80-71b7-4759-95f6-7a65d5edfbb6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.505381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:48.539928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4d534-4e3c-4517-a8a6-cc6d513b4bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.540887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4d534-4e3c-4517-a8a6-cc6d513b4bdd None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.541331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4d534-4e3c-4517-a8a6-cc6d513b4bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.541607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4d534-4e3c-4517-a8a6-cc6d513b4bdd None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.542365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4d534-4e3c-4517-a8a6-cc6d513b4bdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:48.542672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4d534-4e3c-4517-a8a6-cc6d513b4bdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:48.544102 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4d534-4e3c-4517-a8a6-cc6d513b4bdd None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.548687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d4a5-32b4-4e1c-b147-c4afb8c6e9b8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.556526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 411/854] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:48.557229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4d534-4e3c-4517-a8a6-cc6d513b4bdd None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.590860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587a37c-73ed-483b-bf6d-1a43ca2c641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.591523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587a37c-73ed-483b-bf6d-1a43ca2c641a None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.591799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587a37c-73ed-483b-bf6d-1a43ca2c641a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.592071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587a37c-73ed-483b-bf6d-1a43ca2c641a None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.592803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587a37c-73ed-483b-bf6d-1a43ca2c641a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:48.594216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587a37c-73ed-483b-bf6d-1a43ca2c641a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.608404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 444/855] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:29:48 2022] POST /identity/v3/services => generated 269 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:48.609047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587a37c-73ed-483b-bf6d-1a43ca2c641a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.696313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4d534-4e3c-4517-a8a6-cc6d513b4bdd None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.719958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:48.744997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587a37c-73ed-483b-bf6d-1a43ca2c641a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.749296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261dd4e-9017-484e-bf49-be764b996aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.750246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261dd4e-9017-484e-bf49-be764b996aff None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.750599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261dd4e-9017-484e-bf49-be764b996aff None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.750937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261dd4e-9017-484e-bf49-be764b996aff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.767341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261dd4e-9017-484e-bf49-be764b996aff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:48.769530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261dd4e-9017-484e-bf49-be764b996aff None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.785677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d92cc-ff74-4aca-be62-aeca03d4e8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.786587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d92cc-ff74-4aca-be62-aeca03d4e8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.786872 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d92cc-ff74-4aca-be62-aeca03d4e8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.787239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d92cc-ff74-4aca-be62-aeca03d4e8f6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-b261dd4e-9017-484e-bf49-be764b996aff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:48.793432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:48.794514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:48.795502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:48.795502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:48.795502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:48.795502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:48.795502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 412/856] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:48.800779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261dd4e-9017-484e-bf49-be764b996aff None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.800929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d92cc-ff74-4aca-be62-aeca03d4e8f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:48.802475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d92cc-ff74-4aca-be62-aeca03d4e8f6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2c9d92cc-ff74-4aca-be62-aeca03d4e8f6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:48.819515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:48.820479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:48.821428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 445/857] 10.222.0.79 () {56 vars in 1117 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:48.828155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d92cc-ff74-4aca-be62-aeca03d4e8f6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:48.828412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:48.919319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261dd4e-9017-484e-bf49-be764b996aff None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.957123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811e865-a618-4027-9b62-780f6d1f7207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:48.957706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811e865-a618-4027-9b62-780f6d1f7207 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:48.957987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811e865-a618-4027-9b62-780f6d1f7207 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:48.958408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811e865-a618-4027-9b62-780f6d1f7207 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:48.959194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811e865-a618-4027-9b62-780f6d1f7207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:48.959502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811e865-a618-4027-9b62-780f6d1f7207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:48.960926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811e865-a618-4027-9b62-780f6d1f7207 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:48.967285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d92cc-ff74-4aca-be62-aeca03d4e8f6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:48.974745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 413/858] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:48.981889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811e865-a618-4027-9b62-780f6d1f7207 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:49.015848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb149f1-bb2e-45c0-80b2-ab784dbc83f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:49.017957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb149f1-bb2e-45c0-80b2-ab784dbc83f3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:49.018413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb149f1-bb2e-45c0-80b2-ab784dbc83f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:49.019088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb149f1-bb2e-45c0-80b2-ab784dbc83f3 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:49.020072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb149f1-bb2e-45c0-80b2-ab784dbc83f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:49.020541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb149f1-bb2e-45c0-80b2-ab784dbc83f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:49.023355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb149f1-bb2e-45c0-80b2-ab784dbc83f3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:49.050176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 446/859] 10.222.0.79 () {56 vars in 1149 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:49.052521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb149f1-bb2e-45c0-80b2-ab784dbc83f3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:49.056459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:49.079302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:49.107581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811e865-a618-4027-9b62-780f6d1f7207 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:49.154594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb45a30-d457-4a39-93cb-f41ee28541cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:49.156053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb45a30-d457-4a39-93cb-f41ee28541cc None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:49.156519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb45a30-d457-4a39-93cb-f41ee28541cc None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:49.157223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb45a30-d457-4a39-93cb-f41ee28541cc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:49.167967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb45a30-d457-4a39-93cb-f41ee28541cc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:49.169991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb45a30-d457-4a39-93cb-f41ee28541cc None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:49.181169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb149f1-bb2e-45c0-80b2-ab784dbc83f3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-6eb45a30-d457-4a39-93cb-f41ee28541cc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:49.189157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:49.190282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:49.191398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:49.191398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:49.191398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:49.191398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:49.191398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:49.191398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:49.191398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:49.191398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:49.191398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 14:29:49.191398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:49.198357 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 414/860] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:29:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:49.199373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb45a30-d457-4a39-93cb-f41ee28541cc None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:49.223143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03812d-62fd-4e7d-9682-20c30e6c0a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:49.223869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03812d-62fd-4e7d-9682-20c30e6c0a3b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:49.224250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03812d-62fd-4e7d-9682-20c30e6c0a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:49.224702 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe03812d-62fd-4e7d-9682-20c30e6c0a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:49.294560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03812d-62fd-4e7d-9682-20c30e6c0a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:49.296186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe03812d-62fd-4e7d-9682-20c30e6c0a3b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:49.304946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb45a30-d457-4a39-93cb-f41ee28541cc None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:49.318469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:49.340938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b0cd0-cdde-4de7-8a5d-36c3df316b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:49.342208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b0cd0-cdde-4de7-8a5d-36c3df316b3b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:49.342208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b0cd0-cdde-4de7-8a5d-36c3df316b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:49.342656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b0cd0-cdde-4de7-8a5d-36c3df316b3b None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:49.343664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b0cd0-cdde-4de7-8a5d-36c3df316b3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:49.344114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b0cd0-cdde-4de7-8a5d-36c3df316b3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:49.346292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b0cd0-cdde-4de7-8a5d-36c3df316b3b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:49.349110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:49.369567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 415/861] 10.222.0.79 () {56 vars in 1135 bytes} [Wed May 25 14:29:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:49.370679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b0cd0-cdde-4de7-8a5d-36c3df316b3b None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:49.408568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 447/862] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:49 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:49.409715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03812d-62fd-4e7d-9682-20c30e6c0a3b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:49.478511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b0cd0-cdde-4de7-8a5d-36c3df316b3b None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:49.514286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a54569-c8d8-4a3a-a8d0-159efece20b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:49.515000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe03812d-62fd-4e7d-9682-20c30e6c0a3b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:49.515507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a54569-c8d8-4a3a-a8d0-159efece20b9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:49.515985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a54569-c8d8-4a3a-a8d0-159efece20b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:49.516531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:49.516951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a54569-c8d8-4a3a-a8d0-159efece20b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:49.552940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb924b42-bf22-4869-b792-c577ee6a26f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:49.553813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb924b42-bf22-4869-b792-c577ee6a26f4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:49.554108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb924b42-bf22-4869-b792-c577ee6a26f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:49.554416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb924b42-bf22-4869-b792-c577ee6a26f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:49.566206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb924b42-bf22-4869-b792-c577ee6a26f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:49.567642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb924b42-bf22-4869-b792-c577ee6a26f4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:49.584532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-eb924b42-bf22-4869-b792-c577ee6a26f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:49.588668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:49.589601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:49.590493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:49.590493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:49.590493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:49.590493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:49.594484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 448/863] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:49.595385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a54569-c8d8-4a3a-a8d0-159efece20b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:49.597078 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb924b42-bf22-4869-b792-c577ee6a26f4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:49.597532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a54569-c8d8-4a3a-a8d0-159efece20b9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:49.704334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb924b42-bf22-4869-b792-c577ee6a26f4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:49.705527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 416/864] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:49 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:49.706638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a54569-c8d8-4a3a-a8d0-159efece20b9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:49.744039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad502415-cabb-4751-a4a0-a0d450980136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:49.744686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad502415-cabb-4751-a4a0-a0d450980136 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:49.744970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad502415-cabb-4751-a4a0-a0d450980136 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:49.745251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad502415-cabb-4751-a4a0-a0d450980136 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:49.746026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad502415-cabb-4751-a4a0-a0d450980136 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:49.746378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad502415-cabb-4751-a4a0-a0d450980136 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:49.747830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad502415-cabb-4751-a4a0-a0d450980136 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:49.765239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 449/865] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:49.766665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad502415-cabb-4751-a4a0-a0d450980136 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:49.802553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:49.807685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:49.815335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a54569-c8d8-4a3a-a8d0-159efece20b9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:49.862992 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989ba02-09d9-4627-a670-c4f0bed0fa67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:49.864156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989ba02-09d9-4627-a670-c4f0bed0fa67 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:49.864636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989ba02-09d9-4627-a670-c4f0bed0fa67 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:49.865139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989ba02-09d9-4627-a670-c4f0bed0fa67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:49.876105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989ba02-09d9-4627-a670-c4f0bed0fa67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:49.877886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989ba02-09d9-4627-a670-c4f0bed0fa67 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:49.890587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad502415-cabb-4751-a4a0-a0d450980136 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-4989ba02-09d9-4627-a670-c4f0bed0fa67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:49.898065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:49.898951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:49.899816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:49.899816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:49.899816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:49.899816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:49.901954 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 417/866] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:49.907755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989ba02-09d9-4627-a670-c4f0bed0fa67 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:49.931393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eded0-b090-4301-bc49-922486a95653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:49.932527 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eded0-b090-4301-bc49-922486a95653 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:49.933008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eded0-b090-4301-bc49-922486a95653 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:49.933502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39eded0-b090-4301-bc49-922486a95653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:49.940867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39eded0-b090-4301-bc49-922486a95653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:49.942606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39eded0-b090-4301-bc49-922486a95653 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-d39eded0-b090-4301-bc49-922486a95653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:49.957891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:49.958804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:49.959644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:49.959644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:49.959644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:49.959644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:49.959644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:49.959644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:49.959644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:49.959644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:49.962043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 450/867] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:49.967925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eded0-b090-4301-bc49-922486a95653 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:50.031814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989ba02-09d9-4627-a670-c4f0bed0fa67 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:50.074692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:50.082862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fee9b-d5b7-4af5-946c-82aba3134917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:50.084185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fee9b-d5b7-4af5-946c-82aba3134917 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.084869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fee9b-d5b7-4af5-946c-82aba3134917 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.085362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37fee9b-d5b7-4af5-946c-82aba3134917 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.086469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fee9b-d5b7-4af5-946c-82aba3134917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:50.086787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fee9b-d5b7-4af5-946c-82aba3134917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:50.088173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37fee9b-d5b7-4af5-946c-82aba3134917 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:50.103432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 418/868] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:50.109588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fee9b-d5b7-4af5-946c-82aba3134917 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:50.112842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39eded0-b090-4301-bc49-922486a95653 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:50.120941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:50.164274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f33f7d-0e91-4797-8ec5-5cbc50199710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:50.165356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33f7d-0e91-4797-8ec5-5cbc50199710 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.165927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33f7d-0e91-4797-8ec5-5cbc50199710 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.166452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f33f7d-0e91-4797-8ec5-5cbc50199710 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.167657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f33f7d-0e91-4797-8ec5-5cbc50199710 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:50.168251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f33f7d-0e91-4797-8ec5-5cbc50199710 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:50.169980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f33f7d-0e91-4797-8ec5-5cbc50199710 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:50.184072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 451/869] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:50.190717 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f33f7d-0e91-4797-8ec5-5cbc50199710 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:50.233438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37fee9b-d5b7-4af5-946c-82aba3134917 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:50.269170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cf4ac-5b52-4a6f-96a5-6a48ff76bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:50.270122 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cf4ac-5b52-4a6f-96a5-6a48ff76bf8e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.270406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cf4ac-5b52-4a6f-96a5-6a48ff76bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.270680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cf4ac-5b52-4a6f-96a5-6a48ff76bf8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.277975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cf4ac-5b52-4a6f-96a5-6a48ff76bf8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:50.279451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cf4ac-5b52-4a6f-96a5-6a48ff76bf8e None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-bd4cf4ac-5b52-4a6f-96a5-6a48ff76bf8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:50.296708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:50.297572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 419/870] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094508f-e130-468e-888e-e8a7c510c121 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.304098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094508f-e130-468e-888e-e8a7c510c121 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.304692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094508f-e130-468e-888e-e8a7c510c121 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.304692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 420/871] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:50.304692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094508f-e130-468e-888e-e8a7c510c121 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:50.307467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f33f7d-0e91-4797-8ec5-5cbc50199710 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:50.344536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e758390-b2f3-421e-bb14-9713aae84370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:50.345699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e758390-b2f3-421e-bb14-9713aae84370 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.345996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e758390-b2f3-421e-bb14-9713aae84370 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.346302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e758390-b2f3-421e-bb14-9713aae84370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.347131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e758390-b2f3-421e-bb14-9713aae84370 None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=be474c0453a0403b8db884a89fe9e486) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:50.347445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e758390-b2f3-421e-bb14-9713aae84370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:50.348883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e758390-b2f3-421e-bb14-9713aae84370 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:50.350950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:50.366887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 452/872] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:50 2022] GET /identity/v3/role_assignments?user.id=be474c0453a0403b8db884a89fe9e486&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:50.368479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e4518-6f13-4b1a-adf2-f4e7ea36ab78 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.369183 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e4518-6f13-4b1a-adf2-f4e7ea36ab78 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.369896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20e4518-6f13-4b1a-adf2-f4e7ea36ab78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.390422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:50.394740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c20e4518-6f13-4b1a-adf2-f4e7ea36ab78 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:50.397673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c20e4518-6f13-4b1a-adf2-f4e7ea36ab78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:50.442310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094508f-e130-468e-888e-e8a7c510c121 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:50.483182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0058ed4-f562-4549-b074-2262dee10d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:50.483890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0058ed4-f562-4549-b074-2262dee10d7f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.484173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0058ed4-f562-4549-b074-2262dee10d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.484441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0058ed4-f562-4549-b074-2262dee10d7f None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.485430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0058ed4-f562-4549-b074-2262dee10d7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:50.485744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0058ed4-f562-4549-b074-2262dee10d7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:50.488226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0058ed4-f562-4549-b074-2262dee10d7f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:50.494786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 453/873] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:50 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:50.501526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 421/874] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:50.508003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e4518-6f13-4b1a-adf2-f4e7ea36ab78 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:50.519212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0058ed4-f562-4549-b074-2262dee10d7f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:50.639709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20e4518-6f13-4b1a-adf2-f4e7ea36ab78 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:50.652969 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0058ed4-f562-4549-b074-2262dee10d7f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:50.676000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:50.686959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808389e9-a071-4a5f-be17-0f5ea2fad74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:50.687623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808389e9-a071-4a5f-be17-0f5ea2fad74e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.687909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808389e9-a071-4a5f-be17-0f5ea2fad74e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.688187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808389e9-a071-4a5f-be17-0f5ea2fad74e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.688755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:50.689055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808389e9-a071-4a5f-be17-0f5ea2fad74e None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=fa04ddd7a6ce4bbabdfca31721b9c71d) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:50.689938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808389e9-a071-4a5f-be17-0f5ea2fad74e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:50.692299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808389e9-a071-4a5f-be17-0f5ea2fad74e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:50.699512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf129b-e3c3-4a9c-b450-5bc9dd2f4e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:50.699885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 454/875] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:50 2022] GET /identity/v3/role_assignments?user.id=fa04ddd7a6ce4bbabdfca31721b9c71d&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=308d9785120a49079e02659953a2b033 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:50.700184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf129b-e3c3-4a9c-b450-5bc9dd2f4e87 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.700469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf129b-e3c3-4a9c-b450-5bc9dd2f4e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.700748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf129b-e3c3-4a9c-b450-5bc9dd2f4e87 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.701485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf129b-e3c3-4a9c-b450-5bc9dd2f4e87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:50.702893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf129b-e3c3-4a9c-b450-5bc9dd2f4e87 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:50.720230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 422/876] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:29:50 2022] POST /identity/v3/services => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:29:50.941586 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d290d0b-5fed-4029-bf54-746f335588cd None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.941958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d290d0b-5fed-4029-bf54-746f335588cd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.942265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d290d0b-5fed-4029-bf54-746f335588cd None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.943695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 455/877] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:50.948852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a75828-4ba0-4f6f-8bf9-468be0b74bf5 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:50.949144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a75828-4ba0-4f6f-8bf9-468be0b74bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:50.949426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a75828-4ba0-4f6f-8bf9-468be0b74bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:50.967859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-85a75828-4ba0-4f6f-8bf9-468be0b74bf5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:50.969055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-85a75828-4ba0-4f6f-8bf9-468be0b74bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:51.045497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 423/878] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:51.069225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d290d0b-5fed-4029-bf54-746f335588cd None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:51.176872 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d290d0b-5fed-4029-bf54-746f335588cd None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:51.214172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348fa21-a1b5-4b73-8165-8c9851c082a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:51.214905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348fa21-a1b5-4b73-8165-8c9851c082a0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:51.215180 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348fa21-a1b5-4b73-8165-8c9851c082a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:51.215503 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348fa21-a1b5-4b73-8165-8c9851c082a0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:51.216146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348fa21-a1b5-4b73-8165-8c9851c082a0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:51.217616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348fa21-a1b5-4b73-8165-8c9851c082a0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b348fa21-a1b5-4b73-8165-8c9851c082a0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:51.230277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:51.231196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:51.232151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 456/879] 10.222.0.79 () {56 vars in 1132 bytes} [Wed May 25 14:29:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:51.238025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a75828-4ba0-4f6f-8bf9-468be0b74bf5 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:51.343479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a75828-4ba0-4f6f-8bf9-468be0b74bf5 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:51.363234 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:51.386039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da557355-a44e-429f-a031-570228bd4efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:51.386734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da557355-a44e-429f-a031-570228bd4efc None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:51.387018 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da557355-a44e-429f-a031-570228bd4efc None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:51.387295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da557355-a44e-429f-a031-570228bd4efc None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:51.388004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da557355-a44e-429f-a031-570228bd4efc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:51.388306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da557355-a44e-429f-a031-570228bd4efc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:51.389757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da557355-a44e-429f-a031-570228bd4efc None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:51.395535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 424/880] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:29:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:51.401111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348fa21-a1b5-4b73-8165-8c9851c082a0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:51.458706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:51.508555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348fa21-a1b5-4b73-8165-8c9851c082a0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:51.544434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254f63d-ad21-4b49-a2e2-cebe2ce8ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:51.545449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f63d-ad21-4b49-a2e2-cebe2ce8ca7f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:51.545924 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f63d-ad21-4b49-a2e2-cebe2ce8ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:51.546413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254f63d-ad21-4b49-a2e2-cebe2ce8ca7f None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:51.547319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254f63d-ad21-4b49-a2e2-cebe2ce8ca7f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:51.547816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254f63d-ad21-4b49-a2e2-cebe2ce8ca7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:51.549477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9254f63d-ad21-4b49-a2e2-cebe2ce8ca7f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:51.555144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 457/881] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:29:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:51.560989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da557355-a44e-429f-a031-570228bd4efc None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:51.667121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da557355-a44e-429f-a031-570228bd4efc None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:51.702588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a9dd4-3cb1-4a5b-b4da-8f5e47a86af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:51.703248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a9dd4-3cb1-4a5b-b4da-8f5e47a86af7 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:51.703528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a9dd4-3cb1-4a5b-b4da-8f5e47a86af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:51.703801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a9dd4-3cb1-4a5b-b4da-8f5e47a86af7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:51.704623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a9dd4-3cb1-4a5b-b4da-8f5e47a86af7 None admin] RBAC: Adding query filter params (interface=public, service_id=3082ce3135864267a14e3b5902f8ed46, region_id=RegionOne) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:51.704933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a9dd4-3cb1-4a5b-b4da-8f5e47a86af7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:51.706336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a9dd4-3cb1-4a5b-b4da-8f5e47a86af7 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:51.711971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 425/882] 10.222.0.79 () {56 vars in 1251 bytes} [Wed May 25 14:29:51 2022] GET /identity/v3/endpoints?service_id=3082ce3135864267a14e3b5902f8ed46&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:51.717264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254f63d-ad21-4b49-a2e2-cebe2ce8ca7f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:51.825093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9254f63d-ad21-4b49-a2e2-cebe2ce8ca7f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:51.850798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:51.864020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61234d3f-2685-4665-98f5-87578e531c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:51.864684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234d3f-2685-4665-98f5-87578e531c45 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:51.864966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234d3f-2685-4665-98f5-87578e531c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:51.865242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61234d3f-2685-4665-98f5-87578e531c45 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:51.865918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234d3f-2685-4665-98f5-87578e531c45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:51.867334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61234d3f-2685-4665-98f5-87578e531c45 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:51.873629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 458/883] 10.222.0.79 () {56 vars in 1087 bytes} [Wed May 25 14:29:51 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:29:52.772693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4ef8-1aae-40e3-b135-eb9eabbe17e2 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:52.773240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4ef8-1aae-40e3-b135-eb9eabbe17e2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:52.773240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed4ef8-1aae-40e3-b135-eb9eabbe17e2 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:52.774899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 426/884] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:52.780333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34945b93-a352-474e-bca6-b0cc66a6365b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:52.780740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34945b93-a352-474e-bca6-b0cc66a6365b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:52.780897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34945b93-a352-474e-bca6-b0cc66a6365b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:52.798570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-34945b93-a352-474e-bca6-b0cc66a6365b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:52.799760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-34945b93-a352-474e-bca6-b0cc66a6365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:52.871083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 459/885] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:52.895424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed4ef8-1aae-40e3-b135-eb9eabbe17e2 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:52.942236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:53.016188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed4ef8-1aae-40e3-b135-eb9eabbe17e2 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.053657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787016cf-86f9-41a7-80b7-12408266fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.054415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787016cf-86f9-41a7-80b7-12408266fe5e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.054693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787016cf-86f9-41a7-80b7-12408266fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.054960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787016cf-86f9-41a7-80b7-12408266fe5e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.065861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787016cf-86f9-41a7-80b7-12408266fe5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:53.071626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca0c0a-9335-415a-ba19-66ac518b9488 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.071921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca0c0a-9335-415a-ba19-66ac518b9488 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.072208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca0c0a-9335-415a-ba19-66ac518b9488 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.073795 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 460/886] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-787016cf-86f9-41a7-80b7-12408266fe5e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:53.074133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:53.075103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:53.075975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 427/887] 10.222.0.79 () {56 vars in 1120 bytes} [Wed May 25 14:29:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:53.081165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787016cf-86f9-41a7-80b7-12408266fe5e None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.082144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c39b10-788a-4268-8af1-23e8d5db6a9e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.082431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c39b10-788a-4268-8af1-23e8d5db6a9e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.082707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c39b10-788a-4268-8af1-23e8d5db6a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.102558 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c2c39b10-788a-4268-8af1-23e8d5db6a9e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:53.103747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c2c39b10-788a-4268-8af1-23e8d5db6a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:53.185751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 461/888] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:53.190532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:53.194473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b3ced-fd24-4b27-a6fb-a092f831101f None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.194769 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b3ced-fd24-4b27-a6fb-a092f831101f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.195046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b3ced-fd24-4b27-a6fb-a092f831101f None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.196569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 462/889] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:53.199000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787016cf-86f9-41a7-80b7-12408266fe5e None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.202592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9b8ac-536b-4513-9267-08a8e452c4e4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.202592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9b8ac-536b-4513-9267-08a8e452c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.202592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9b8ac-536b-4513-9267-08a8e452c4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.219060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b6a9b8ac-536b-4513-9267-08a8e452c4e4 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:53.220773 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b6a9b8ac-536b-4513-9267-08a8e452c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:53.241896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b7c7-9add-45dd-a066-7d36bb69434d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.243016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b7c7-9add-45dd-a066-7d36bb69434d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.243472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b7c7-9add-45dd-a066-7d36bb69434d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.243738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6b7c7-9add-45dd-a066-7d36bb69434d None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.244491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b7c7-9add-45dd-a066-7d36bb69434d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:53.244801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b7c7-9add-45dd-a066-7d36bb69434d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:53.246211 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6b7c7-9add-45dd-a066-7d36bb69434d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:53.254838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 428/890] 10.222.0.79 () {56 vars in 1115 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:53.255615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b7c7-9add-45dd-a066-7d36bb69434d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.269874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:53.301986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 463/891] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:53 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:53.303193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9b8ac-536b-4513-9267-08a8e452c4e4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.363325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6b7c7-9add-45dd-a066-7d36bb69434d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.397143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc0191-2724-45e8-b62c-53cce45c6355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.398226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc0191-2724-45e8-b62c-53cce45c6355 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.398513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc0191-2724-45e8-b62c-53cce45c6355 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.398788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc0191-2724-45e8-b62c-53cce45c6355 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.399439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc0191-2724-45e8-b62c-53cce45c6355 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:53.400817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc0191-2724-45e8-b62c-53cce45c6355 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-16bc0191-2724-45e8-b62c-53cce45c6355 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:53.413526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:53.414555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:53.415386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 429/892] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:53.416171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc0191-2724-45e8-b62c-53cce45c6355 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.431188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9b8ac-536b-4513-9267-08a8e452c4e4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.447346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:53.466484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cadb5-fff6-452c-99ec-af51cccf75b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.467384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cadb5-fff6-452c-99ec-af51cccf75b6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.467668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cadb5-fff6-452c-99ec-af51cccf75b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.468023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4cadb5-fff6-452c-99ec-af51cccf75b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.479655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cadb5-fff6-452c-99ec-af51cccf75b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:53.481435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4cadb5-fff6-452c-99ec-af51cccf75b6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-9d4cadb5-fff6-452c-99ec-af51cccf75b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:53.500250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:53.501401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:53.502376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:53.502376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:53.502376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:53.502376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:53.502376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 464/893] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:53.502681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cadb5-fff6-452c-99ec-af51cccf75b6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.529961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc0191-2724-45e8-b62c-53cce45c6355 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.534656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:53.567574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef416-98cd-4737-9f09-c3330d283d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.568376 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef416-98cd-4737-9f09-c3330d283d2c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.568660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef416-98cd-4737-9f09-c3330d283d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.568937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eef416-98cd-4737-9f09-c3330d283d2c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.569593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef416-98cd-4737-9f09-c3330d283d2c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:53.571001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eef416-98cd-4737-9f09-c3330d283d2c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-c1eef416-98cd-4737-9f09-c3330d283d2c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:53.583449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:53.584498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:53.585348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 430/894] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:53.586673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef416-98cd-4737-9f09-c3330d283d2c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.617484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4cadb5-fff6-452c-99ec-af51cccf75b6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.653782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e3ca2-4d14-4e7e-a898-4761dcfbe814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.654726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e3ca2-4d14-4e7e-a898-4761dcfbe814 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.655187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e3ca2-4d14-4e7e-a898-4761dcfbe814 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.655608 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e3ca2-4d14-4e7e-a898-4761dcfbe814 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.656462 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e3ca2-4d14-4e7e-a898-4761dcfbe814 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:53.656927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e3ca2-4d14-4e7e-a898-4761dcfbe814 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:53.658875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e3ca2-4d14-4e7e-a898-4761dcfbe814 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:53.664012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 465/895] 10.222.0.79 () {56 vars in 1122 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:53.664880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e3ca2-4d14-4e7e-a898-4761dcfbe814 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.684338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:53.694752 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eef416-98cd-4737-9f09-c3330d283d2c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.731435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b57fc-c9d8-421c-a2de-20c640b0e83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.732211 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b57fc-c9d8-421c-a2de-20c640b0e83d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.732493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b57fc-c9d8-421c-a2de-20c640b0e83d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.732769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b57fc-c9d8-421c-a2de-20c640b0e83d None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.733485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b57fc-c9d8-421c-a2de-20c640b0e83d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:53.733790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b57fc-c9d8-421c-a2de-20c640b0e83d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:53.735225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b57fc-c9d8-421c-a2de-20c640b0e83d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:53.752953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 431/896] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:53.752953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b57fc-c9d8-421c-a2de-20c640b0e83d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.768428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:53.779552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e3ca2-4d14-4e7e-a898-4761dcfbe814 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.814051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776583-5e7c-4830-b235-14c1acdea3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.814725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776583-5e7c-4830-b235-14c1acdea3db None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.814995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776583-5e7c-4830-b235-14c1acdea3db None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.815265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf776583-5e7c-4830-b235-14c1acdea3db None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.815966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf776583-5e7c-4830-b235-14c1acdea3db None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:53.816265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf776583-5e7c-4830-b235-14c1acdea3db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:53.817619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf776583-5e7c-4830-b235-14c1acdea3db None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:53.822075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 466/897] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:53.822857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776583-5e7c-4830-b235-14c1acdea3db None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.873522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b57fc-c9d8-421c-a2de-20c640b0e83d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.909796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6809d-2857-4d75-af89-511275610dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.910485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6809d-2857-4d75-af89-511275610dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.910770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6809d-2857-4d75-af89-511275610dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.911043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6809d-2857-4d75-af89-511275610dc4 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:53.911752 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6809d-2857-4d75-af89-511275610dc4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:53.912060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6809d-2857-4d75-af89-511275610dc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:53.913439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba6809d-2857-4d75-af89-511275610dc4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:53.917996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 432/898] 10.222.0.79 () {56 vars in 1122 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:53.918800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6809d-2857-4d75-af89-511275610dc4 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:53.948396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:53.950394 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf776583-5e7c-4830-b235-14c1acdea3db None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:53.992554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bfe22-e0ae-40ef-bd17-58c88113ed10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:53.993713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bfe22-e0ae-40ef-bd17-58c88113ed10 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:53.993991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bfe22-e0ae-40ef-bd17-58c88113ed10 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:53.994293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bfe22-e0ae-40ef-bd17-58c88113ed10 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.002779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bfe22-e0ae-40ef-bd17-58c88113ed10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.004259 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bfe22-e0ae-40ef-bd17-58c88113ed10 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-613bfe22-e0ae-40ef-bd17-58c88113ed10 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:54.020730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:54.021772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:54.022756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:54.022756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:54.022756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:54.022756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:54.022756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:54.022756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:54.022756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:54.022756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:54.022756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:29:54.022756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:54.026416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 467/899] 10.222.0.79 () {56 vars in 1117 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:54.027746 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bfe22-e0ae-40ef-bd17-58c88113ed10 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.045487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.073234 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba6809d-2857-4d75-af89-511275610dc4 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.110024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab666de-b035-4092-a78e-ab86185d2f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.111412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab666de-b035-4092-a78e-ab86185d2f88 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.111751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab666de-b035-4092-a78e-ab86185d2f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.111944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab666de-b035-4092-a78e-ab86185d2f88 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.112779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab666de-b035-4092-a78e-ab86185d2f88 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:54.112956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab666de-b035-4092-a78e-ab86185d2f88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.114429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab666de-b035-4092-a78e-ab86185d2f88 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.124666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 433/900] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:54.127149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab666de-b035-4092-a78e-ab86185d2f88 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.156187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bfe22-e0ae-40ef-bd17-58c88113ed10 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.199913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1cd40-a491-466e-b00f-3c1dd31521ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.201042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1cd40-a491-466e-b00f-3c1dd31521ce None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.201323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1cd40-a491-466e-b00f-3c1dd31521ce None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.201718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1cd40-a491-466e-b00f-3c1dd31521ce None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.202663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1cd40-a491-466e-b00f-3c1dd31521ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:54.202974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1cd40-a491-466e-b00f-3c1dd31521ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.204464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1cd40-a491-466e-b00f-3c1dd31521ce None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.220229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.223632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 468/901] 10.222.0.79 () {56 vars in 1149 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:54.224947 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a444a-4e23-42e3-9766-62820df93168 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.225243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a444a-4e23-42e3-9766-62820df93168 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.225521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a444a-4e23-42e3-9766-62820df93168 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.227040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 469/902] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:54.228986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a444a-4e23-42e3-9766-62820df93168 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.247182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab666de-b035-4092-a78e-ab86185d2f88 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.282006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ffcd8-0e9f-4708-a0a3-29e618e689c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.282742 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ffcd8-0e9f-4708-a0a3-29e618e689c7 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.283056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ffcd8-0e9f-4708-a0a3-29e618e689c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.283339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ffcd8-0e9f-4708-a0a3-29e618e689c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.284154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ffcd8-0e9f-4708-a0a3-29e618e689c7 None admin] RBAC: Adding query filter params (interface=public, service_id=bec7503770294fbaae6061f921e588c9, region_id=RegionOne) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:54.284470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ffcd8-0e9f-4708-a0a3-29e618e689c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.285842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ffcd8-0e9f-4708-a0a3-29e618e689c7 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.291286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 434/903] 10.222.0.79 () {56 vars in 1251 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/endpoints?service_id=bec7503770294fbaae6061f921e588c9&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:54.292364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd803c27-283c-44b0-aff7-213f2c68f2c7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.292652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd803c27-283c-44b0-aff7-213f2c68f2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.292928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd803c27-283c-44b0-aff7-213f2c68f2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.309534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-dd803c27-283c-44b0-aff7-213f2c68f2c7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:54.310756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-dd803c27-283c-44b0-aff7-213f2c68f2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:54.310890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.346094 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a444a-4e23-42e3-9766-62820df93168 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.390187 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 435/904] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:54.390187 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd803c27-283c-44b0-aff7-213f2c68f2c7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.392886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52d9f-0adc-4505-9909-41cf010696ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.393612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52d9f-0adc-4505-9909-41cf010696ae None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.393967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52d9f-0adc-4505-9909-41cf010696ae None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.394348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b52d9f-0adc-4505-9909-41cf010696ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.464419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.467054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b52d9f-0adc-4505-9909-41cf010696ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.468534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b52d9f-0adc-4505-9909-41cf010696ae None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.491023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd803c27-283c-44b0-aff7-213f2c68f2c7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.526459 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b835e-ee5c-41ab-b900-8964c7604ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.527132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b835e-ee5c-41ab-b900-8964c7604ddd None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.527416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b835e-ee5c-41ab-b900-8964c7604ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.527693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b835e-ee5c-41ab-b900-8964c7604ddd None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.528383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b835e-ee5c-41ab-b900-8964c7604ddd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.529750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b835e-ee5c-41ab-b900-8964c7604ddd None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.535684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 436/905] 10.222.0.79 () {56 vars in 1087 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:29:54.539276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b835e-ee5c-41ab-b900-8964c7604ddd None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.541972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.587458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 470/906] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:29:54.595259 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52d9f-0adc-4505-9909-41cf010696ae None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.670313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b835e-ee5c-41ab-b900-8964c7604ddd None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.712843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770451b-838f-48ec-8cf9-456b99b198ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.714069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770451b-838f-48ec-8cf9-456b99b198ad None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.714580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770451b-838f-48ec-8cf9-456b99b198ad None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.715076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770451b-838f-48ec-8cf9-456b99b198ad None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.715946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770451b-838f-48ec-8cf9-456b99b198ad None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.717552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770451b-838f-48ec-8cf9-456b99b198ad None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.721243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-f770451b-838f-48ec-8cf9-456b99b198ad None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:54.733549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:54.734735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 14:29:54.735764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:54.736712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 437/907] 10.222.0.79 () {56 vars in 1132 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:54.742756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770451b-838f-48ec-8cf9-456b99b198ad None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.744242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b52d9f-0adc-4505-9909-41cf010696ae None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.793006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cbf0b-4da9-48c2-9197-5c08cd957a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.794658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cbf0b-4da9-48c2-9197-5c08cd957a35 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.795564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cbf0b-4da9-48c2-9197-5c08cd957a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.796323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415cbf0b-4da9-48c2-9197-5c08cd957a35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.810392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cbf0b-4da9-48c2-9197-5c08cd957a35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.813061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415cbf0b-4da9-48c2-9197-5c08cd957a35 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-415cbf0b-4da9-48c2-9197-5c08cd957a35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:54.837940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:54.839307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:54.840190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:54.840190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:54.840190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:54.840190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:54.842666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 471/908] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:54.854760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cbf0b-4da9-48c2-9197-5c08cd957a35 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.869781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770451b-838f-48ec-8cf9-456b99b198ad None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:54.879669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:54.918990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54146bf9-47ca-4454-8911-64afa52a7c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:54.921040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54146bf9-47ca-4454-8911-64afa52a7c1f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:54.921609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54146bf9-47ca-4454-8911-64afa52a7c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:54.922168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54146bf9-47ca-4454-8911-64afa52a7c1f None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:54.923033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54146bf9-47ca-4454-8911-64afa52a7c1f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:54.923521 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54146bf9-47ca-4454-8911-64afa52a7c1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:54.925266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54146bf9-47ca-4454-8911-64afa52a7c1f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:54.932571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 438/909] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:54.941049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54146bf9-47ca-4454-8911-64afa52a7c1f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:54.965510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415cbf0b-4da9-48c2-9197-5c08cd957a35 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:55.002761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea02d6-6829-4a0c-a722-561a48614da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:55.003693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea02d6-6829-4a0c-a722-561a48614da7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:55.003975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea02d6-6829-4a0c-a722-561a48614da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:55.004250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea02d6-6829-4a0c-a722-561a48614da7 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:55.005133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea02d6-6829-4a0c-a722-561a48614da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:55.005442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea02d6-6829-4a0c-a722-561a48614da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:55.005764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:55.007339 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ea02d6-6829-4a0c-a722-561a48614da7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:55.023199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 472/910] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:55.028144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea02d6-6829-4a0c-a722-561a48614da7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:55.049690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54146bf9-47ca-4454-8911-64afa52a7c1f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:55.086152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e6e17-6447-414a-9149-111814c4c4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:55.087251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e6e17-6447-414a-9149-111814c4c4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:55.087757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e6e17-6447-414a-9149-111814c4c4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:55.088242 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e6e17-6447-414a-9149-111814c4c4b6 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:55.089185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e6e17-6447-414a-9149-111814c4c4b6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:55.089730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e6e17-6447-414a-9149-111814c4c4b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:55.091679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e6e17-6447-414a-9149-111814c4c4b6 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:55.103407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 439/911] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:29:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:55.105104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e6e17-6447-414a-9149-111814c4c4b6 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:55.150438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:55.161564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea02d6-6829-4a0c-a722-561a48614da7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:55.204840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925638f-35b6-4ad1-b03c-b3dbac4032f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:55.205823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925638f-35b6-4ad1-b03c-b3dbac4032f3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:55.206131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925638f-35b6-4ad1-b03c-b3dbac4032f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:55.206413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925638f-35b6-4ad1-b03c-b3dbac4032f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:55.215779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925638f-35b6-4ad1-b03c-b3dbac4032f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:55.217171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e6e17-6447-414a-9149-111814c4c4b6 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:55.218544 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925638f-35b6-4ad1-b03c-b3dbac4032f3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b925638f-35b6-4ad1-b03c-b3dbac4032f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:55.237654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:55.238629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:55.239670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:55.239670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:55.239670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:55.239670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:55.239670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:55.239670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:55.239670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:55.239670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:55.239670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 473/912] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:55.244509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925638f-35b6-4ad1-b03c-b3dbac4032f3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:55.250798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:55.264083 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31f0c4-01be-49eb-b816-20babe64a758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:55.265336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31f0c4-01be-49eb-b816-20babe64a758 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:55.266251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31f0c4-01be-49eb-b816-20babe64a758 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:55.267572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d31f0c4-01be-49eb-b816-20babe64a758 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:55.268830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31f0c4-01be-49eb-b816-20babe64a758 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:55.270860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d31f0c4-01be-49eb-b816-20babe64a758 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:55.299144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 440/913] 10.222.0.79 () {60 vars in 1144 bytes} [Wed May 25 14:29:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:29:55.369749 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925638f-35b6-4ad1-b03c-b3dbac4032f3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:55.416942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554db21-2ed1-40e6-ac16-ad827a923f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:55.417620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554db21-2ed1-40e6-ac16-ad827a923f59 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:55.417904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554db21-2ed1-40e6-ac16-ad827a923f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:55.418209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554db21-2ed1-40e6-ac16-ad827a923f59 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:55.419015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554db21-2ed1-40e6-ac16-ad827a923f59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:55.419329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554db21-2ed1-40e6-ac16-ad827a923f59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:55.420907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a554db21-2ed1-40e6-ac16-ad827a923f59 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:55.430930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:55.436384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 474/914] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:55.442452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31f0c4-01be-49eb-b816-20babe64a758 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:55.552643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d31f0c4-01be-49eb-b816-20babe64a758 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:55.587804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2881b97-1803-43fd-82b6-fd21744a2444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:55.588514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2881b97-1803-43fd-82b6-fd21744a2444 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:55.588795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2881b97-1803-43fd-82b6-fd21744a2444 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:55.589068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2881b97-1803-43fd-82b6-fd21744a2444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:55.589956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2881b97-1803-43fd-82b6-fd21744a2444 None admin] RBAC: Adding query filter params (role.id=eb76f2b0416948d0b129dd08f0ddba37, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=be474c0453a0403b8db884a89fe9e486) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:55.590301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2881b97-1803-43fd-82b6-fd21744a2444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:55.591806 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2881b97-1803-43fd-82b6-fd21744a2444 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:55.598801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 441/915] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:29:55 2022] GET /identity/v3/role_assignments?user.id=be474c0453a0403b8db884a89fe9e486&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=eb76f2b0416948d0b129dd08f0ddba37 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:56.225378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ef05e-4492-4a10-b002-f8c83430dcc4 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:56.225915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ef05e-4492-4a10-b002-f8c83430dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:56.225915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ef05e-4492-4a10-b002-f8c83430dcc4 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:56.227606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 475/916] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:56.232877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e45a7-b170-41bc-b5df-9ae3fd291e7e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:56.233281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e45a7-b170-41bc-b5df-9ae3fd291e7e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:56.233450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e45a7-b170-41bc-b5df-9ae3fd291e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:56.250873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-cd1e45a7-b170-41bc-b5df-9ae3fd291e7e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:56.252098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-cd1e45a7-b170-41bc-b5df-9ae3fd291e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:56.296825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:56.322161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 442/917] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:56.344816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ef05e-4492-4a10-b002-f8c83430dcc4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:56.455280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ef05e-4492-4a10-b002-f8c83430dcc4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:56.493125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da29ac-422d-48e6-a43b-ef986dad1190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:56.493713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da29ac-422d-48e6-a43b-ef986dad1190 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:56.493997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da29ac-422d-48e6-a43b-ef986dad1190 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:56.494308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da29ac-422d-48e6-a43b-ef986dad1190 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:56.495038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da29ac-422d-48e6-a43b-ef986dad1190 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:56.496417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da29ac-422d-48e6-a43b-ef986dad1190 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:56.511133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 476/918] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:29:56 2022] POST /identity/v3/services => generated 241 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:56.822120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b573952-8faa-4da9-bf35-a9fe972bb117 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:56.822434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b573952-8faa-4da9-bf35-a9fe972bb117 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:56.822616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b573952-8faa-4da9-bf35-a9fe972bb117 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:56.824349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 443/919] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:56.830011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7a3aa-c268-40a7-aaed-efb7949b9bde None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:56.830337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7a3aa-c268-40a7-aaed-efb7949b9bde None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:56.830613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a7a3aa-c268-40a7-aaed-efb7949b9bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:56.848293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-90a7a3aa-c268-40a7-aaed-efb7949b9bde None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:56.849485 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-90a7a3aa-c268-40a7-aaed-efb7949b9bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:56.908531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:56.927450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 477/920] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:29:56.950961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b573952-8faa-4da9-bf35-a9fe972bb117 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:57.056137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b573952-8faa-4da9-bf35-a9fe972bb117 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:57.091817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81693c-7e7f-4b23-abfa-cfe8c3cdb4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:57.092598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81693c-7e7f-4b23-abfa-cfe8c3cdb4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:57.092880 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81693c-7e7f-4b23-abfa-cfe8c3cdb4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:57.093205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81693c-7e7f-4b23-abfa-cfe8c3cdb4f3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:57.093863 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81693c-7e7f-4b23-abfa-cfe8c3cdb4f3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:57.095302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81693c-7e7f-4b23-abfa-cfe8c3cdb4f3 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-be81693c-7e7f-4b23-abfa-cfe8c3cdb4f3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:57.107609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:57.108589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:57.109429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 444/921] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:57.115224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7a3aa-c268-40a7-aaed-efb7949b9bde None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:57.217866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a7a3aa-c268-40a7-aaed-efb7949b9bde None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:57.259640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420717e5-7582-4a10-8d7e-c14279c21098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:57.261004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420717e5-7582-4a10-8d7e-c14279c21098 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:57.261506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420717e5-7582-4a10-8d7e-c14279c21098 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:57.262006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420717e5-7582-4a10-8d7e-c14279c21098 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:57.263397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420717e5-7582-4a10-8d7e-c14279c21098 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:57.263963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420717e5-7582-4a10-8d7e-c14279c21098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:57.266565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420717e5-7582-4a10-8d7e-c14279c21098 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:57.275549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 478/922] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:57.281105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81693c-7e7f-4b23-abfa-cfe8c3cdb4f3 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:57.327817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:57.387224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81693c-7e7f-4b23-abfa-cfe8c3cdb4f3 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:57.427511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041878a-f63d-4e56-b755-7491cce9eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:57.428264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041878a-f63d-4e56-b755-7491cce9eaec None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:57.428549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041878a-f63d-4e56-b755-7491cce9eaec None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:57.428826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041878a-f63d-4e56-b755-7491cce9eaec None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:57.429610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041878a-f63d-4e56-b755-7491cce9eaec None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:57.429923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041878a-f63d-4e56-b755-7491cce9eaec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:57.431360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d041878a-f63d-4e56-b755-7491cce9eaec None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:57.437394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 445/923] 10.222.0.79 () {56 vars in 1114 bytes} [Wed May 25 14:29:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:57.442985 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420717e5-7582-4a10-8d7e-c14279c21098 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:57.498753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:57.554229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420717e5-7582-4a10-8d7e-c14279c21098 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:57.589351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c0521-44da-417b-a153-ea4c8c5a544f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:57.590017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c0521-44da-417b-a153-ea4c8c5a544f None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:57.590328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c0521-44da-417b-a153-ea4c8c5a544f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:57.590606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c0521-44da-417b-a153-ea4c8c5a544f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:57.591361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c0521-44da-417b-a153-ea4c8c5a544f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:57.592750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30c0521-44da-417b-a153-ea4c8c5a544f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:57.602615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dec68-c9aa-471f-9e4b-6d2b14f0a85d None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:57.602615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dec68-c9aa-471f-9e4b-6d2b14f0a85d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:57.602615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dec68-c9aa-471f-9e4b-6d2b14f0a85d None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:57.604064 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 446/924] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:57.608744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b591-bd8e-437d-a60c-44d62301205a None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:57.609034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b591-bd8e-437d-a60c-44d62301205a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:57.609308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50b591-bd8e-437d-a60c-44d62301205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:57.617124 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 479/925] 10.222.0.79 () {60 vars in 1144 bytes} [Wed May 25 14:29:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:29:57.628606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-ec50b591-bd8e-437d-a60c-44d62301205a None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:57.629914 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ec50b591-bd8e-437d-a60c-44d62301205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:57.713835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 447/926] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:57.737373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c0521-44da-417b-a153-ea4c8c5a544f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:57.862833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c0521-44da-417b-a153-ea4c8c5a544f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:57.871626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:57.904214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8dbca-23ae-4486-a338-0e9ae7393c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:57.905015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8dbca-23ae-4486-a338-0e9ae7393c21 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:57.905296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8dbca-23ae-4486-a338-0e9ae7393c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:57.905573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c8dbca-23ae-4486-a338-0e9ae7393c21 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:57.906255 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8dbca-23ae-4486-a338-0e9ae7393c21 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:57.907660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c8dbca-23ae-4486-a338-0e9ae7393c21 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:57.914574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30a9b-b9b4-4432-a7f2-45e0854a0cd7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:57.914867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30a9b-b9b4-4432-a7f2-45e0854a0cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:57.915143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d30a9b-b9b4-4432-a7f2-45e0854a0cd7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:57.916653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 448/927] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:29:57.921849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd8b2-3aa3-44f7-9729-029bfd1d4c16 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:57.922337 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd8b2-3aa3-44f7-9729-029bfd1d4c16 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:57.922777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dd8b2-3aa3-44f7-9729-029bfd1d4c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-45c8dbca-23ae-4486-a338-0e9ae7393c21 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:57.922998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:57.924132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:57.925036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 480/928] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:57.932414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8dbca-23ae-4486-a338-0e9ae7393c21 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:57.949508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a39dd8b2-3aa3-44f7-9729-029bfd1d4c16 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:57.951179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a39dd8b2-3aa3-44f7-9729-029bfd1d4c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:57.985023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:58.062176 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 449/929] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:58.095548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd8b2-3aa3-44f7-9729-029bfd1d4c16 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:58.098214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c8dbca-23ae-4486-a338-0e9ae7393c21 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:58.162802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c01e0-0e85-4386-b837-81bae4f6ad3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:58.164329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c01e0-0e85-4386-b837-81bae4f6ad3e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:58.164814 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c01e0-0e85-4386-b837-81bae4f6ad3e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:58.165291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c01e0-0e85-4386-b837-81bae4f6ad3e None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:58.166563 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c01e0-0e85-4386-b837-81bae4f6ad3e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:58.167098 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c01e0-0e85-4386-b837-81bae4f6ad3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:58.170748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c01e0-0e85-4386-b837-81bae4f6ad3e None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:58.182164 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 481/930] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:29:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:58.186164 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c01e0-0e85-4386-b837-81bae4f6ad3e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:58.231295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:58.240883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dd8b2-3aa3-44f7-9729-029bfd1d4c16 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:58.277592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11f0e-2598-43b7-b87c-a0408ac3d7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:58.278841 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11f0e-2598-43b7-b87c-a0408ac3d7ce None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:58.279309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11f0e-2598-43b7-b87c-a0408ac3d7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:58.279759 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e11f0e-2598-43b7-b87c-a0408ac3d7ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:58.290827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e11f0e-2598-43b7-b87c-a0408ac3d7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-30e11f0e-2598-43b7-b87c-a0408ac3d7ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:29:58.299940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:58.301042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:29:58.302050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:58.307221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c01e0-0e85-4386-b837-81bae4f6ad3e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:58.307988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 450/931] 10.222.0.79 () {56 vars in 1120 bytes} [Wed May 25 14:29:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:58.308871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11f0e-2598-43b7-b87c-a0408ac3d7ce None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:58.334759 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:58.348766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0efde-27a9-44b9-ac60-4a4bfe630b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:58.349639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0efde-27a9-44b9-ac60-4a4bfe630b52 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:58.350108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0efde-27a9-44b9-ac60-4a4bfe630b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:58.350539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0efde-27a9-44b9-ac60-4a4bfe630b52 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:58.351905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0efde-27a9-44b9-ac60-4a4bfe630b52 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:58.352356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0efde-27a9-44b9-ac60-4a4bfe630b52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:58.354400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0efde-27a9-44b9-ac60-4a4bfe630b52 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:58.366488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 482/932] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:29:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:58.422772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e11f0e-2598-43b7-b87c-a0408ac3d7ce None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:58.459507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ef46c-3985-420f-b9c1-7f153e8544f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:58.460186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ef46c-3985-420f-b9c1-7f153e8544f4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:58.460469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ef46c-3985-420f-b9c1-7f153e8544f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:58.460744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ef46c-3985-420f-b9c1-7f153e8544f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:58.461564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ef46c-3985-420f-b9c1-7f153e8544f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:58.461878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ef46c-3985-420f-b9c1-7f153e8544f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:58.463308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ef46c-3985-420f-b9c1-7f153e8544f4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:58.477878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 451/933] 10.222.0.79 () {56 vars in 1115 bytes} [Wed May 25 14:29:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:58.483328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0efde-27a9-44b9-ac60-4a4bfe630b52 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:58.600038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:58.604160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0efde-27a9-44b9-ac60-4a4bfe630b52 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:58.639521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4859c-cec1-4ba1-92da-236a6347a3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:58.640670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4859c-cec1-4ba1-92da-236a6347a3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:58.641169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4859c-cec1-4ba1-92da-236a6347a3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:58.641638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4859c-cec1-4ba1-92da-236a6347a3a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:58.652593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4859c-cec1-4ba1-92da-236a6347a3a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:58.654304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f4859c-cec1-4ba1-92da-236a6347a3a0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-02f4859c-cec1-4ba1-92da-236a6347a3a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:58.672429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:58.673417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:58.674377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:58.674377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:58.674377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:58.674377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:58.676820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 483/934] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:58.683562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ef46c-3985-420f-b9c1-7f153e8544f4 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:58.783559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:58.801800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ef46c-3985-420f-b9c1-7f153e8544f4 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:58.840805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d2fec-243b-40df-a208-8e530d179c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:58.841880 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d2fec-243b-40df-a208-8e530d179c74 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:58.842480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d2fec-243b-40df-a208-8e530d179c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:58.842971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d2fec-243b-40df-a208-8e530d179c74 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:58.843940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d2fec-243b-40df-a208-8e530d179c74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:58.844490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d2fec-243b-40df-a208-8e530d179c74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:58.846699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d2fec-243b-40df-a208-8e530d179c74 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:58.860543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 452/935] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:58.866136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4859c-cec1-4ba1-92da-236a6347a3a0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:58.867059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176b5d-b265-4dde-97e6-b985ae068e31 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:58.867353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176b5d-b265-4dde-97e6-b985ae068e31 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:58.867631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f176b5d-b265-4dde-97e6-b985ae068e31 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:58.868931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 453/936] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:29:58.873861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffcf12-5f0d-41d9-928c-ce0026db8cc2 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:58.874178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffcf12-5f0d-41d9-928c-ce0026db8cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:58.874465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ffcf12-5f0d-41d9-928c-ce0026db8cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:58.890968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-71ffcf12-5f0d-41d9-928c-ce0026db8cc2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:29:58.892673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-71ffcf12-5f0d-41d9-928c-ce0026db8cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:29:58.972778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 454/937] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:29:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:29:58.989590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4859c-cec1-4ba1-92da-236a6347a3a0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:58.996950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffcf12-5f0d-41d9-928c-ce0026db8cc2 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:59.029031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e598e4-6eb2-4e08-9529-f8edd95599f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:59.030347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e598e4-6eb2-4e08-9529-f8edd95599f3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:59.030836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e598e4-6eb2-4e08-9529-f8edd95599f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:59.031373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e598e4-6eb2-4e08-9529-f8edd95599f3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:59.040472 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e598e4-6eb2-4e08-9529-f8edd95599f3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:59.042231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e598e4-6eb2-4e08-9529-f8edd95599f3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-04e598e4-6eb2-4e08-9529-f8edd95599f3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:29:59.058698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:59.059667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:59.060590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:59.060590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:59.060590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:29:59.060590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:29:59.060590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:29:59.060590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:29:59.060590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:29:59.060590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:29:59.060590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:29:59.060590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:59.063441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 484/938] 10.222.0.79 () {56 vars in 1117 bytes} [Wed May 25 14:29:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:59.068533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e598e4-6eb2-4e08-9529-f8edd95599f3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:59.086935 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:59.087458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:59.121374 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ffcf12-5f0d-41d9-928c-ce0026db8cc2 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:59.161897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e5ed0-a3e3-4199-ae44-270717963791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:59.162818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e5ed0-a3e3-4199-ae44-270717963791 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:59.163148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e5ed0-a3e3-4199-ae44-270717963791 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:59.163367 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e5ed0-a3e3-4199-ae44-270717963791 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:59.164026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e5ed0-a3e3-4199-ae44-270717963791 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:59.165401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e5ed0-a3e3-4199-ae44-270717963791 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-684e5ed0-a3e3-4199-ae44-270717963791 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:59.178256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:59.179268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:29:59.185620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 455/939] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:29:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:29:59.187648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e5ed0-a3e3-4199-ae44-270717963791 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:59.211251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e598e4-6eb2-4e08-9529-f8edd95599f3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:59.249920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6ec07-ae41-4872-9617-82ef084ee235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:59.250633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ec07-ae41-4872-9617-82ef084ee235 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:59.250916 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ec07-ae41-4872-9617-82ef084ee235 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:59.251223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af6ec07-ae41-4872-9617-82ef084ee235 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:59.252129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6ec07-ae41-4872-9617-82ef084ee235 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:59.252438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6ec07-ae41-4872-9617-82ef084ee235 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:59.253929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af6ec07-ae41-4872-9617-82ef084ee235 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:59.283006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 485/940] 10.222.0.79 () {56 vars in 1149 bytes} [Wed May 25 14:29:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:59.284378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6ec07-ae41-4872-9617-82ef084ee235 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:59.320391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e5ed0-a3e3-4199-ae44-270717963791 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:59.363396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db363a-375a-45b5-b896-2da4c6dcaee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:59.364435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db363a-375a-45b5-b896-2da4c6dcaee4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:59.365171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db363a-375a-45b5-b896-2da4c6dcaee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:59.365674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00db363a-375a-45b5-b896-2da4c6dcaee4 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:59.366679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:59.368899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db363a-375a-45b5-b896-2da4c6dcaee4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:59.369557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db363a-375a-45b5-b896-2da4c6dcaee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:59.372838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00db363a-375a-45b5-b896-2da4c6dcaee4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:59.379904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 456/941] 10.222.0.79 () {56 vars in 1122 bytes} [Wed May 25 14:29:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:59.385564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db363a-375a-45b5-b896-2da4c6dcaee4 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:59.389428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:59.407995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af6ec07-ae41-4872-9617-82ef084ee235 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:59.455520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d97bc-08a1-4790-ac1d-3618e1e6f0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:59.457379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d97bc-08a1-4790-ac1d-3618e1e6f0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:59.458166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d97bc-08a1-4790-ac1d-3618e1e6f0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:59.458651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d97bc-08a1-4790-ac1d-3618e1e6f0e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:59.474014 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d97bc-08a1-4790-ac1d-3618e1e6f0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:59.475769 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d97bc-08a1-4790-ac1d-3618e1e6f0e8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-101d97bc-08a1-4790-ac1d-3618e1e6f0e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:29:59.503059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:59.503995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:59.504875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:29:59.504875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:29:59.504875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:29:59.504875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:59.509179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 486/942] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:59.510318 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d97bc-08a1-4790-ac1d-3618e1e6f0e8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:59.519734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00db363a-375a-45b5-b896-2da4c6dcaee4 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:59.565690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61725c-0188-448a-8b25-45345771cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:59.566548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61725c-0188-448a-8b25-45345771cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:59.566902 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61725c-0188-448a-8b25-45345771cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:59.567414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61725c-0188-448a-8b25-45345771cdd6 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:59.568041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61725c-0188-448a-8b25-45345771cdd6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:59.568419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61725c-0188-448a-8b25-45345771cdd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:59.569872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61725c-0188-448a-8b25-45345771cdd6 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:59.575616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 457/943] 10.222.0.79 () {56 vars in 1122 bytes} [Wed May 25 14:29:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:59.584198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61725c-0188-448a-8b25-45345771cdd6 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:59.643130 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d97bc-08a1-4790-ac1d-3618e1e6f0e8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:59.658863 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:59.674627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:59.695574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff849e45-78cc-4f2e-8198-9b101e549359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:59.696797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff849e45-78cc-4f2e-8198-9b101e549359 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:59.697664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff849e45-78cc-4f2e-8198-9b101e549359 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:59.698278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff849e45-78cc-4f2e-8198-9b101e549359 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:59.699281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff849e45-78cc-4f2e-8198-9b101e549359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:59.699787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff849e45-78cc-4f2e-8198-9b101e549359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:59.700484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61725c-0188-448a-8b25-45345771cdd6 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:59.701559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff849e45-78cc-4f2e-8198-9b101e549359 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:59.720454 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 487/944] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:29:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:29:59.721549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff849e45-78cc-4f2e-8198-9b101e549359 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:59.745905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49664df7-ee68-49ef-a8bf-b2e64ef7a83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:59.747159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49664df7-ee68-49ef-a8bf-b2e64ef7a83d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:59.748055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49664df7-ee68-49ef-a8bf-b2e64ef7a83d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:59.748662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49664df7-ee68-49ef-a8bf-b2e64ef7a83d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:59.749744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49664df7-ee68-49ef-a8bf-b2e64ef7a83d None admin] RBAC: Adding query filter params (interface=public, service_id=2b694c32e5034e0eaac5870c65aaf04c, region_id=RegionOne) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:29:59.750501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49664df7-ee68-49ef-a8bf-b2e64ef7a83d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:59.752776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49664df7-ee68-49ef-a8bf-b2e64ef7a83d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:59.763750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 458/945] 10.222.0.79 () {56 vars in 1251 bytes} [Wed May 25 14:29:59 2022] GET /identity/v3/endpoints?service_id=2b694c32e5034e0eaac5870c65aaf04c&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:29:59.764695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49664df7-ee68-49ef-a8bf-b2e64ef7a83d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:59.848812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff849e45-78cc-4f2e-8198-9b101e549359 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:59.890364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de083d1-24d8-4a91-a226-1c74fd62e951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:59.891101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de083d1-24d8-4a91-a226-1c74fd62e951 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:59.891462 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de083d1-24d8-4a91-a226-1c74fd62e951 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:59.891805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de083d1-24d8-4a91-a226-1c74fd62e951 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:59.899827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de083d1-24d8-4a91-a226-1c74fd62e951 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:59.901285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de083d1-24d8-4a91-a226-1c74fd62e951 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:59.902271 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49664df7-ee68-49ef-a8bf-b2e64ef7a83d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-6de083d1-24d8-4a91-a226-1c74fd62e951 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:29:59.916298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:29:59.917223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:29:59.918136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:29:59.918136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:29:59.918136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:29:59.918136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:29:59.918136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:29:59.918136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:29:59.918136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:29:59.918136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:29:59.922618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 488/946] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:29:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:29:59.923640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de083d1-24d8-4a91-a226-1c74fd62e951 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:29:59.940600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:29:59.949493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa03c3-8767-43dd-b4c2-9678aedfd6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:29:59.950702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa03c3-8767-43dd-b4c2-9678aedfd6be None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:29:59.951187 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa03c3-8767-43dd-b4c2-9678aedfd6be None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:29:59.952002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa03c3-8767-43dd-b4c2-9678aedfd6be None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:29:59.953144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa03c3-8767-43dd-b4c2-9678aedfd6be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:29:59.955507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa03c3-8767-43dd-b4c2-9678aedfd6be None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:29:59.964299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 459/947] 10.222.0.79 () {56 vars in 1087 bytes} [Wed May 25 14:29:59 2022] GET /identity/v3/services => generated 1497 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:29:59.972774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:00.035686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e0b50-f522-4477-98b2-d1ceeff9f2ae None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:00.036032 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e0b50-f522-4477-98b2-d1ceeff9f2ae None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:00.036248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5e0b50-f522-4477-98b2-d1ceeff9f2ae None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:00.037979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 460/948] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:30:00.042969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de083d1-24d8-4a91-a226-1c74fd62e951 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:00.043643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ba635-1bb1-4026-972a-6c768e0872d5 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:00.043926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ba635-1bb1-4026-972a-6c768e0872d5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:00.044198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ba635-1bb1-4026-972a-6c768e0872d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:00.062728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-bb0ba635-1bb1-4026-972a-6c768e0872d5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:00.064304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-bb0ba635-1bb1-4026-972a-6c768e0872d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:00.093253 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dce37-5522-4016-a959-30360340c4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:00.095587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dce37-5522-4016-a959-30360340c4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:00.096177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dce37-5522-4016-a959-30360340c4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:00.097031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6dce37-5522-4016-a959-30360340c4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:00.098811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dce37-5522-4016-a959-30360340c4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:00.099462 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dce37-5522-4016-a959-30360340c4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:00.101521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6dce37-5522-4016-a959-30360340c4b5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:00.120373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 489/949] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:29:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:00.126163 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dce37-5522-4016-a959-30360340c4b5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:00.146375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 461/950] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:30:00.165315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ba635-1bb1-4026-972a-6c768e0872d5 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:00.261660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:00.267418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6dce37-5522-4016-a959-30360340c4b5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:00.285575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ba635-1bb1-4026-972a-6c768e0872d5 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:00.313345 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a01568-8c7e-45a1-8a18-b2a9ca1d1904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:00.315194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a01568-8c7e-45a1-8a18-b2a9ca1d1904 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:00.315679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a01568-8c7e-45a1-8a18-b2a9ca1d1904 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:00.316176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a01568-8c7e-45a1-8a18-b2a9ca1d1904 None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/be474c0453a0403b8db884a89fe9e486/roles/eb76f2b0416948d0b129dd08f0ddba37` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:00.318475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:00.319316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a01568-8c7e-45a1-8a18-b2a9ca1d1904 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=be474c0453a0403b8db884a89fe9e486, role_id=eb76f2b0416948d0b129dd08f0ddba37)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:00.321081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a01568-8c7e-45a1-8a18-b2a9ca1d1904 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:00.332817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:00.333482 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:00.333834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:00.334025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:00.334753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:00.336285 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:00.337658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: WARNING keystone.server.flask.common [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 14:30:00.338380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 490/951] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:30:00 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/be474c0453a0403b8db884a89fe9e486/roles/eb76f2b0416948d0b129dd08f0ddba37 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:30:00.361480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.sql.core [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:30:00.361480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 14:30:00.361480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [parameters: {'id': 'fbdf53dc4b9349e688e9deadd8a028c0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 14:30:00.361480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80476) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fbdf53dc4b9349e688e9deadd8a028c0.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fbdf53dc4b9349e688e9deadd8a028c0. May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application conn.query(q) May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:30:00.369890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result.read() May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 14:30:00.370792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application next(self.gen) May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application yield resource May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application next(self.gen) May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise self.value May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application session.commit() May 25 14:30:00.371747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.session.flush() May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application compat.raise_( May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:30:00.372606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:30:00.373491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application conn.query(q) May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result.read() May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:30:00.375371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [parameters: {'id': 'fbdf53dc4b9349e688e9deadd8a028c0', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:00.378069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:00.386318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:00.387267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:00.387267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 14:30:00.387267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 14:30:00.387267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:00.387267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:00.387267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 14:30:00.387267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 14:30:00.387267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fbdf53dc4b9349e688e9deadd8a028c0. May 25 14:30:00.387267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:00.387267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 462/952] 10.222.0.79 () {60 vars in 1140 bytes} [Wed May 25 14:30:00 2022] POST /identity/v3/projects => generated 262 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:00.387943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a01568-8c7e-45a1-8a18-b2a9ca1d1904 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:00.512496 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a01568-8c7e-45a1-8a18-b2a9ca1d1904 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:00.550299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec167fa-d213-4dd2-b95c-33dd22957ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:00.551210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec167fa-d213-4dd2-b95c-33dd22957ccb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:00.551493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec167fa-d213-4dd2-b95c-33dd22957ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:00.551765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec167fa-d213-4dd2-b95c-33dd22957ccb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:00.558779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec167fa-d213-4dd2-b95c-33dd22957ccb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:00.560249 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec167fa-d213-4dd2-b95c-33dd22957ccb None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-dec167fa-d213-4dd2-b95c-33dd22957ccb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:30:00.577361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:00.578538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:00.579710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:30:00.579710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:30:00.579710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:30:00.579710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:30:00.579710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:30:00.579710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:30:00.579710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:30:00.579710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:00.579710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 491/953] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:30:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:00.586142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:00.671804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc31966-97a9-43de-a454-ac2221bc8245 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:00.672188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc31966-97a9-43de-a454-ac2221bc8245 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:00.672535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc31966-97a9-43de-a454-ac2221bc8245 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:00.675455 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 492/954] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:30:00.682469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a0e25-60e7-4a9a-8e70-bbbf62340a01 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:00.682948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a0e25-60e7-4a9a-8e70-bbbf62340a01 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:00.683451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a0e25-60e7-4a9a-8e70-bbbf62340a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:00.698403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae64d9-b551-4d0b-b415-c625be18f99f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:00.703620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6a6a0e25-60e7-4a9a-8e70-bbbf62340a01 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:00.705079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6a6a0e25-60e7-4a9a-8e70-bbbf62340a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:00.727538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:00.737983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b9bc1-a835-420b-beda-ee59c4220f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:00.739204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b9bc1-a835-420b-beda-ee59c4220f2f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:00.740343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b9bc1-a835-420b-beda-ee59c4220f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:00.740719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b9bc1-a835-420b-beda-ee59c4220f2f None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:00.741570 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b9bc1-a835-420b-beda-ee59c4220f2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:00.741977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b9bc1-a835-420b-beda-ee59c4220f2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:00.743987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971b9bc1-a835-420b-beda-ee59c4220f2f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:00.774197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 463/955] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:30:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:00.797008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 493/956] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:30:00.820900 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b9bc1-a835-420b-beda-ee59c4220f2f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:00.871585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:00.963821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b9bc1-a835-420b-beda-ee59c4220f2f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:01.008075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ac3153-8461-4bc0-9e5c-9d82a4d54ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:01.008766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac3153-8461-4bc0-9e5c-9d82a4d54ee1 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:01.009144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac3153-8461-4bc0-9e5c-9d82a4d54ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:01.009430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ac3153-8461-4bc0-9e5c-9d82a4d54ee1 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:01.010471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac3153-8461-4bc0-9e5c-9d82a4d54ee1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:01.011915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ac3153-8461-4bc0-9e5c-9d82a4d54ee1 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:01.036418 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 464/957] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:30:00 2022] POST /identity/v3/services => generated 242 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:30:02.394211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66bfb-91da-4f3a-93f7-043ea94cde5a None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:02.395224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66bfb-91da-4f3a-93f7-043ea94cde5a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:02.395738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae66bfb-91da-4f3a-93f7-043ea94cde5a None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:02.397592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 494/958] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:02.403366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe05c42-b137-4369-9be7-303f59ade783 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:02.404214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe05c42-b137-4369-9be7-303f59ade783 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:02.404734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe05c42-b137-4369-9be7-303f59ade783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:02.422243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7fe05c42-b137-4369-9be7-303f59ade783 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:02.424163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7fe05c42-b137-4369-9be7-303f59ade783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:02.505197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 465/959] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:02.528531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae66bfb-91da-4f3a-93f7-043ea94cde5a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:02.643506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae66bfb-91da-4f3a-93f7-043ea94cde5a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:02.678514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105538-fa32-4036-92ab-baa88f871160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:02.679321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105538-fa32-4036-92ab-baa88f871160 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:02.679605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105538-fa32-4036-92ab-baa88f871160 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:02.679937 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105538-fa32-4036-92ab-baa88f871160 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:02.680594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06105538-fa32-4036-92ab-baa88f871160 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:02.682109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06105538-fa32-4036-92ab-baa88f871160 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-06105538-fa32-4036-92ab-baa88f871160 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:02.694624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:02.695957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:02.697093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 495/960] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:30:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:02.704613 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe05c42-b137-4369-9be7-303f59ade783 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:02.762526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:02.787367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23571b-6c48-4270-8afa-a5d1005beb8a None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:02.787680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23571b-6c48-4270-8afa-a5d1005beb8a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:02.789190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23571b-6c48-4270-8afa-a5d1005beb8a None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:02.789514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 496/961] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:02.794785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2c6c-9ce4-4cb6-8a47-7d8c62e1f04d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:02.795074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2c6c-9ce4-4cb6-8a47-7d8c62e1f04d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:02.795357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace2c6c-9ce4-4cb6-8a47-7d8c62e1f04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:02.816590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5ace2c6c-9ce4-4cb6-8a47-7d8c62e1f04d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:02.817079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe05c42-b137-4369-9be7-303f59ade783 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:02.818366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5ace2c6c-9ce4-4cb6-8a47-7d8c62e1f04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:02.834450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:02.866789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923662b-c75c-4a70-b7d6-959e4e2eb8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:02.867568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923662b-c75c-4a70-b7d6-959e4e2eb8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:02.867944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923662b-c75c-4a70-b7d6-959e4e2eb8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:02.868438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923662b-c75c-4a70-b7d6-959e4e2eb8a5 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:02.869246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923662b-c75c-4a70-b7d6-959e4e2eb8a5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:02.870287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923662b-c75c-4a70-b7d6-959e4e2eb8a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:02.876564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923662b-c75c-4a70-b7d6-959e4e2eb8a5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:02.883992 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 466/962] 10.222.0.79 () {56 vars in 1122 bytes} [Wed May 25 14:30:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:02.899070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923662b-c75c-4a70-b7d6-959e4e2eb8a5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:02.908003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 497/963] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:30:02.931521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace2c6c-9ce4-4cb6-8a47-7d8c62e1f04d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:03.006503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:03.017392 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923662b-c75c-4a70-b7d6-959e4e2eb8a5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:03.034698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace2c6c-9ce4-4cb6-8a47-7d8c62e1f04d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:03.058037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8833cf0-0784-40a6-b027-d38e54b8ce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:03.059209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8833cf0-0784-40a6-b027-d38e54b8ce5b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.059797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8833cf0-0784-40a6-b027-d38e54b8ce5b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.060274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8833cf0-0784-40a6-b027-d38e54b8ce5b None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.061215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8833cf0-0784-40a6-b027-d38e54b8ce5b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:03.061768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8833cf0-0784-40a6-b027-d38e54b8ce5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:03.063748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8833cf0-0784-40a6-b027-d38e54b8ce5b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:03.069986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 467/964] 10.222.0.79 () {56 vars in 1122 bytes} [Wed May 25 14:30:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:03.075203 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8833cf0-0784-40a6-b027-d38e54b8ce5b None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:03.076199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee724511-980d-4760-aacc-392ab9098804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:03.077449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee724511-980d-4760-aacc-392ab9098804 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.077772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee724511-980d-4760-aacc-392ab9098804 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.078051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee724511-980d-4760-aacc-392ab9098804 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.091860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee724511-980d-4760-aacc-392ab9098804 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-ee724511-980d-4760-aacc-392ab9098804 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:30:03.103115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:03.104082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:30:03.104915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:03.109428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 498/965] 10.222.0.79 () {56 vars in 1120 bytes} [Wed May 25 14:30:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:03.111657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee724511-980d-4760-aacc-392ab9098804 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:03.116452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:03.208848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8833cf0-0784-40a6-b027-d38e54b8ce5b None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:03.235107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee724511-980d-4760-aacc-392ab9098804 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:03.253877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545486b-67e9-49f0-9262-63479c294686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:03.254940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545486b-67e9-49f0-9262-63479c294686 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.254940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545486b-67e9-49f0-9262-63479c294686 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.255242 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545486b-67e9-49f0-9262-63479c294686 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.256079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545486b-67e9-49f0-9262-63479c294686 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:03.257500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545486b-67e9-49f0-9262-63479c294686 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:03.286239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 468/966] 10.222.0.79 () {60 vars in 1144 bytes} [Wed May 25 14:30:03 2022] POST /identity/v3/endpoints => generated 349 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:30:03.301039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0acdd18-90e7-4c96-8e6b-be133dfc97fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:03.301804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acdd18-90e7-4c96-8e6b-be133dfc97fd None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.302107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acdd18-90e7-4c96-8e6b-be133dfc97fd None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.302418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0acdd18-90e7-4c96-8e6b-be133dfc97fd None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.303282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acdd18-90e7-4c96-8e6b-be133dfc97fd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:03.303596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acdd18-90e7-4c96-8e6b-be133dfc97fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:03.305231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0acdd18-90e7-4c96-8e6b-be133dfc97fd None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:03.321552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 499/967] 10.222.0.79 () {56 vars in 1115 bytes} [Wed May 25 14:30:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:03.323333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545486b-67e9-49f0-9262-63479c294686 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:03.342480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:03.442744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545486b-67e9-49f0-9262-63479c294686 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:03.460783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e6e3-7b04-4653-b7e4-a246c71069aa None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.461271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e6e3-7b04-4653-b7e4-a246c71069aa None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.461271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71e6e3-7b04-4653-b7e4-a246c71069aa None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.462918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 500/968] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:30:03.468596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170c78-2b2d-4ba2-9aeb-9231079b39ac None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.468877 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170c78-2b2d-4ba2-9aeb-9231079b39ac None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.469154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78170c78-2b2d-4ba2-9aeb-9231079b39ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.483246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeb16b0-03c4-4a57-91b7-4497e66b283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:03.484056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb16b0-03c4-4a57-91b7-4497e66b283c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.484341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb16b0-03c4-4a57-91b7-4497e66b283c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.484618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeb16b0-03c4-4a57-91b7-4497e66b283c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.488897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-78170c78-2b2d-4ba2-9aeb-9231079b39ac None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:03.490198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-78170c78-2b2d-4ba2-9aeb-9231079b39ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:03.497137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb16b0-03c4-4a57-91b7-4497e66b283c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:03.498624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeb16b0-03c4-4a57-91b7-4497e66b283c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-bdeb16b0-03c4-4a57-91b7-4497e66b283c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:03.519152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:03.520100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:03.521000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:30:03.521000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:03.521000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:03.521000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:03.525772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 469/969] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:03.526571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc96b7-bf9b-46c7-ab8d-dad5196dc01c None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.526856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc96b7-bf9b-46c7-ab8d-dad5196dc01c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.527691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc96b7-bf9b-46c7-ab8d-dad5196dc01c None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.528467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 470/970] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:03.529225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc96b7-bf9b-46c7-ab8d-dad5196dc01c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:03.552222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:03.565320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 501/971] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:30:03.566710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc0618-4e8b-4fa0-9741-6d42d1dbe994 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.566998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc0618-4e8b-4fa0-9741-6d42d1dbe994 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.567279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdc0618-4e8b-4fa0-9741-6d42d1dbe994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.590690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-efdc0618-4e8b-4fa0-9741-6d42d1dbe994 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:03.591879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-efdc0618-4e8b-4fa0-9741-6d42d1dbe994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:03.603421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:03.646719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc96b7-bf9b-46c7-ab8d-dad5196dc01c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:03.665959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 502/972] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:03.667133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc0618-4e8b-4fa0-9741-6d42d1dbe994 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:03.689674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248aebc-156c-4eeb-9b01-113ad87789b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:03.690909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248aebc-156c-4eeb-9b01-113ad87789b6 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.691575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248aebc-156c-4eeb-9b01-113ad87789b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.691875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248aebc-156c-4eeb-9b01-113ad87789b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.693038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248aebc-156c-4eeb-9b01-113ad87789b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:03.693301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248aebc-156c-4eeb-9b01-113ad87789b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:03.694664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248aebc-156c-4eeb-9b01-113ad87789b6 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:03.707625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 471/973] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:03.708273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248aebc-156c-4eeb-9b01-113ad87789b6 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:03.776009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdc0618-4e8b-4fa0-9741-6d42d1dbe994 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:03.799906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:03.812650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248aebc-156c-4eeb-9b01-113ad87789b6 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:03.814101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae7818-d768-4664-99e8-f68220a6b689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:03.814911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae7818-d768-4664-99e8-f68220a6b689 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.815193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae7818-d768-4664-99e8-f68220a6b689 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.816196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae7818-d768-4664-99e8-f68220a6b689 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.816196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae7818-d768-4664-99e8-f68220a6b689 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:03.817525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ae7818-d768-4664-99e8-f68220a6b689 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-e9ae7818-d768-4664-99e8-f68220a6b689 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:03.831578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:03.832597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:03.833430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 503/974] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:30:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:03.838344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae7818-d768-4664-99e8-f68220a6b689 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:03.847230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:03.863240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401ed54-335c-4cf7-b878-5ddb5708255b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:03.864172 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ed54-335c-4cf7-b878-5ddb5708255b None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.864462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ed54-335c-4cf7-b878-5ddb5708255b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.865159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401ed54-335c-4cf7-b878-5ddb5708255b None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.866260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401ed54-335c-4cf7-b878-5ddb5708255b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:03.868169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401ed54-335c-4cf7-b878-5ddb5708255b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:03.882869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.sql.core [None req-e401ed54-335c-4cf7-b878-5ddb5708255b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:30:03.882869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 14:30:03.882869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [parameters: {'user_id': '9a8bf8e6753940a48bc083c5847f8dad', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 14:30:03.882869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80476) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-e401ed54-335c-4cf7-b878-5ddb5708255b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application conn.query(q) May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result.read() May 25 14:30:03.890455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:30:03.891343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application next(self.gen) May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application yield resource May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application next(self.gen) May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.session.rollback() May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.force_reraise() May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise self.value May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application session.commit() May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 14:30:03.892827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._prepare_impl() May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.session.flush() May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._flush(objects) May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application compat.raise_( May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application flush_context.execute() May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rec.execute(self) May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 14:30:03.893718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 14:30:03.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result = self._query(query) May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application conn.query(q) May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application result.read() May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 14:30:03.898656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [parameters: {'user_id': '9a8bf8e6753940a48bc083c5847f8dad', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:03.900701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 14:30:03.903353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 14:30:03.906439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 14:30:03.906439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 14:30:03.906439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 14:30:03.906439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 14:30:03.906439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 14:30:03.906439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:03.906439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 472/975] 10.222.0.79 () {60 vars in 1131 bytes} [Wed May 25 14:30:03 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:03.906439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401ed54-335c-4cf7-b878-5ddb5708255b None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:03.951634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae7818-d768-4664-99e8-f68220a6b689 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:03.990322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201a5a-ad18-46ab-9c52-f3c47f1b942b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:03.991140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201a5a-ad18-46ab-9c52-f3c47f1b942b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:03.991426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201a5a-ad18-46ab-9c52-f3c47f1b942b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:03.991703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62201a5a-ad18-46ab-9c52-f3c47f1b942b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:03.999503 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62201a5a-ad18-46ab-9c52-f3c47f1b942b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:04.001027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62201a5a-ad18-46ab-9c52-f3c47f1b942b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:04.002489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401ed54-335c-4cf7-b878-5ddb5708255b None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-62201a5a-ad18-46ab-9c52-f3c47f1b942b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:30:04.016862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:04.018040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 504/976] 10.222.0.79 () {56 vars in 1117 bytes} [Wed May 25 14:30:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:04.024156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201a5a-ad18-46ab-9c52-f3c47f1b942b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:04.050163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9cf50-e114-483f-9d36-06cd1a4749db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:04.050756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9cf50-e114-483f-9d36-06cd1a4749db None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:04.051041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9cf50-e114-483f-9d36-06cd1a4749db None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:04.051313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9cf50-e114-483f-9d36-06cd1a4749db None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:04.052024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9cf50-e114-483f-9d36-06cd1a4749db None admin] RBAC: Adding query filter params (name=compute) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:04.052332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9cf50-e114-483f-9d36-06cd1a4749db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:04.053917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9cf50-e114-483f-9d36-06cd1a4749db None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:04.066917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 473/977] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:30:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:04.066917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9cf50-e114-483f-9d36-06cd1a4749db None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:04.074620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:04.119073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:04.136286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62201a5a-ad18-46ab-9c52-f3c47f1b942b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:04.170767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4200dd-c8b6-4a87-aac9-bd43c1e28560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:04.171709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4200dd-c8b6-4a87-aac9-bd43c1e28560 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:04.172063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4200dd-c8b6-4a87-aac9-bd43c1e28560 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:04.172396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4200dd-c8b6-4a87-aac9-bd43c1e28560 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:04.174963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9cf50-e114-483f-9d36-06cd1a4749db None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:04.181304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4200dd-c8b6-4a87-aac9-bd43c1e28560 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:04.182786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4200dd-c8b6-4a87-aac9-bd43c1e28560 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-8b4200dd-c8b6-4a87-aac9-bd43c1e28560 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:30:04.197422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:04.198553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:04.199523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 505/978] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:30:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:04.200137 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4200dd-c8b6-4a87-aac9-bd43c1e28560 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:04.215502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e2e04-cf75-44fb-9851-82781ae23267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:04.216167 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e2e04-cf75-44fb-9851-82781ae23267 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:04.216454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e2e04-cf75-44fb-9851-82781ae23267 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:04.216728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e2e04-cf75-44fb-9851-82781ae23267 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:04.217565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e2e04-cf75-44fb-9851-82781ae23267 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:04.217880 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e2e04-cf75-44fb-9851-82781ae23267 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:04.219339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436e2e04-cf75-44fb-9851-82781ae23267 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:04.237504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 474/979] 10.222.0.79 () {56 vars in 1149 bytes} [Wed May 25 14:30:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:04.238353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e2e04-cf75-44fb-9851-82781ae23267 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:04.308146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4200dd-c8b6-4a87-aac9-bd43c1e28560 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:04.315637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:04.339092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e2e04-cf75-44fb-9851-82781ae23267 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:04.346656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2090e80-8237-47a1-8756-45f739a0fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:04.347319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090e80-8237-47a1-8756-45f739a0fff3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:04.347659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090e80-8237-47a1-8756-45f739a0fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:04.348058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:04.348335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2090e80-8237-47a1-8756-45f739a0fff3 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:04.349118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2090e80-8237-47a1-8756-45f739a0fff3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:04.349464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2090e80-8237-47a1-8756-45f739a0fff3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:04.351273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2090e80-8237-47a1-8756-45f739a0fff3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:04.356683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 506/980] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:30:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:04.362284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2090e80-8237-47a1-8756-45f739a0fff3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:04.377320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d614d-8e1a-42d9-b1eb-230f46fe2ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:04.377990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d614d-8e1a-42d9-b1eb-230f46fe2ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:04.378302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d614d-8e1a-42d9-b1eb-230f46fe2ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:04.378581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d614d-8e1a-42d9-b1eb-230f46fe2ad2 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:04.379392 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d614d-8e1a-42d9-b1eb-230f46fe2ad2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:04.379700 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d614d-8e1a-42d9-b1eb-230f46fe2ad2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:04.381132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d614d-8e1a-42d9-b1eb-230f46fe2ad2 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:04.426118 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 475/981] 10.222.0.79 () {56 vars in 1101 bytes} [Wed May 25 14:30:04 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:04.426118 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d614d-8e1a-42d9-b1eb-230f46fe2ad2 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:04.487828 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2090e80-8237-47a1-8756-45f739a0fff3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:04.525693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7015ea-dd9a-478d-8cbe-90ee6672e541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:04.526532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7015ea-dd9a-478d-8cbe-90ee6672e541 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:04.526890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7015ea-dd9a-478d-8cbe-90ee6672e541 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:04.527233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7015ea-dd9a-478d-8cbe-90ee6672e541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:04.538099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d614d-8e1a-42d9-b1eb-230f46fe2ad2 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:04.575468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab769-20f4-4c3c-8dba-696a7df21bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:04.576053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab769-20f4-4c3c-8dba-696a7df21bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:04.576335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab769-20f4-4c3c-8dba-696a7df21bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:04.576612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ab769-20f4-4c3c-8dba-696a7df21bc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:04.577411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ab769-20f4-4c3c-8dba-696a7df21bc3 None admin] RBAC: Adding query filter params (interface=public, service_id=7cc72c49509048e7b31994dbc4ff4bb4, region_id=RegionOne) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:04.577727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ab769-20f4-4c3c-8dba-696a7df21bc3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:04.579193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ab769-20f4-4c3c-8dba-696a7df21bc3 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:04.581139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:04.590968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 476/982] 10.222.0.79 () {56 vars in 1251 bytes} [Wed May 25 14:30:04 2022] GET /identity/v3/endpoints?service_id=7cc72c49509048e7b31994dbc4ff4bb4&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:04.593296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab769-20f4-4c3c-8dba-696a7df21bc3 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:04.615179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7015ea-dd9a-478d-8cbe-90ee6672e541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:04.617284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7015ea-dd9a-478d-8cbe-90ee6672e541 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:04.627007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:04.717886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ab769-20f4-4c3c-8dba-696a7df21bc3 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:04.745152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 507/983] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:04 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:30:04.751477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7015ea-dd9a-478d-8cbe-90ee6672e541 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:04.766542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ca15-194b-4434-a9cc-c7b0e374af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:04.767571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ca15-194b-4434-a9cc-c7b0e374af95 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:04.767571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ca15-194b-4434-a9cc-c7b0e374af95 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:04.767758 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1ca15-194b-4434-a9cc-c7b0e374af95 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:04.768425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1ca15-194b-4434-a9cc-c7b0e374af95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:04.769787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1ca15-194b-4434-a9cc-c7b0e374af95 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:04.777439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 477/984] 10.222.0.79 () {56 vars in 1087 bytes} [Wed May 25 14:30:04 2022] GET /identity/v3/services => generated 1727 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:30:04.835246 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:04.876848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7015ea-dd9a-478d-8cbe-90ee6672e541 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:04.914138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0817bd9-b770-4702-870b-3a3226590318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:04.915047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0817bd9-b770-4702-870b-3a3226590318 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:04.915335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0817bd9-b770-4702-870b-3a3226590318 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:04.915612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0817bd9-b770-4702-870b-3a3226590318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:04.927866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0817bd9-b770-4702-870b-3a3226590318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:04.929339 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0817bd9-b770-4702-870b-3a3226590318 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a0817bd9-b770-4702-870b-3a3226590318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:04.949020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:04.949999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:04.950923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:30:04.950923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:04.950923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:04.950923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:04.950923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 508/985] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:04.955889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ca15-194b-4434-a9cc-c7b0e374af95 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:05.050852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:05.060491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1ca15-194b-4434-a9cc-c7b0e374af95 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:05.096731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834f51d-b141-46ef-8f61-fcd4e0aac25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:05.097310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834f51d-b141-46ef-8f61-fcd4e0aac25d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:05.097590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834f51d-b141-46ef-8f61-fcd4e0aac25d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:05.097862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834f51d-b141-46ef-8f61-fcd4e0aac25d None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:05.098606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834f51d-b141-46ef-8f61-fcd4e0aac25d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:05.098910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834f51d-b141-46ef-8f61-fcd4e0aac25d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:05.100270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834f51d-b141-46ef-8f61-fcd4e0aac25d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:05.111817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 478/986] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:30:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:05.117398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0817bd9-b770-4702-870b-3a3226590318 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:05.218638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0817bd9-b770-4702-870b-3a3226590318 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:05.241656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:05.254696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca302df-a5cb-4de5-9b1a-42d0e02774fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:05.255490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca302df-a5cb-4de5-9b1a-42d0e02774fe None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:05.255768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca302df-a5cb-4de5-9b1a-42d0e02774fe None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:05.256040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca302df-a5cb-4de5-9b1a-42d0e02774fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:05.262917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca302df-a5cb-4de5-9b1a-42d0e02774fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:05.264358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca302df-a5cb-4de5-9b1a-42d0e02774fe None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-4ca302df-a5cb-4de5-9b1a-42d0e02774fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:30:05.278567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:05.279492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:05.280406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:30:05.280406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:30:05.280406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:30:05.280406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:30:05.280406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:30:05.280406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:30:05.280406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:30:05.280406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:05.282434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 509/987] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:30:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:05.285496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834f51d-b141-46ef-8f61-fcd4e0aac25d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:05.390351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834f51d-b141-46ef-8f61-fcd4e0aac25d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:05.434558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6204fe-3ab3-40b6-91e7-294a2dcf1fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:05.435223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6204fe-3ab3-40b6-91e7-294a2dcf1fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:05.435505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6204fe-3ab3-40b6-91e7-294a2dcf1fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:05.435781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6204fe-3ab3-40b6-91e7-294a2dcf1fb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:05.436561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6204fe-3ab3-40b6-91e7-294a2dcf1fb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:05.436870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6204fe-3ab3-40b6-91e7-294a2dcf1fb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:05.438354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6204fe-3ab3-40b6-91e7-294a2dcf1fb7 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:05.450681 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 479/988] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:30:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:05.456563 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca302df-a5cb-4de5-9b1a-42d0e02774fe None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:05.556632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca302df-a5cb-4de5-9b1a-42d0e02774fe None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:05.563658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa5423-3591-44b8-bff3-de58a0dfb5a2 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:05.564082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa5423-3591-44b8-bff3-de58a0dfb5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:05.564198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaa5423-3591-44b8-bff3-de58a0dfb5a2 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:05.565691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 480/989] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:05.570784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a25b-df2a-49f6-88dc-9fb3e26f23d6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:05.571073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a25b-df2a-49f6-88dc-9fb3e26f23d6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:05.571351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f6a25b-df2a-49f6-88dc-9fb3e26f23d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:05.591199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-14f6a25b-df2a-49f6-88dc-9fb3e26f23d6 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:05.593163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-14f6a25b-df2a-49f6-88dc-9fb3e26f23d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:05.593963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864c67c-91f3-4f65-b2b4-fb5e21826028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:05.595227 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864c67c-91f3-4f65-b2b4-fb5e21826028 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:05.595510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864c67c-91f3-4f65-b2b4-fb5e21826028 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:05.595783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864c67c-91f3-4f65-b2b4-fb5e21826028 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:05.596760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864c67c-91f3-4f65-b2b4-fb5e21826028 None admin] RBAC: Adding query filter params (role.id=eb76f2b0416948d0b129dd08f0ddba37, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=be474c0453a0403b8db884a89fe9e486) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:05.597343 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864c67c-91f3-4f65-b2b4-fb5e21826028 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:05.599972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864c67c-91f3-4f65-b2b4-fb5e21826028 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:05.603988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:05.607092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 510/990] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:30:05 2022] GET /identity/v3/role_assignments?user.id=be474c0453a0403b8db884a89fe9e486&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=eb76f2b0416948d0b129dd08f0ddba37 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:05.670154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 481/991] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:05.692840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864c67c-91f3-4f65-b2b4-fb5e21826028 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:05.744520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:05.805781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864c67c-91f3-4f65-b2b4-fb5e21826028 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:05.843660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18aa0ab-20a2-4d21-b8f5-a5d3d446a60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:05.843660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18aa0ab-20a2-4d21-b8f5-a5d3d446a60b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:05.843660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18aa0ab-20a2-4d21-b8f5-a5d3d446a60b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:05.843660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18aa0ab-20a2-4d21-b8f5-a5d3d446a60b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:05.844086 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18aa0ab-20a2-4d21-b8f5-a5d3d446a60b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:05.847091 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18aa0ab-20a2-4d21-b8f5-a5d3d446a60b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a18aa0ab-20a2-4d21-b8f5-a5d3d446a60b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:05.860159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:05.861109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:05.861918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 511/992] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:30:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:05.867651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a25b-df2a-49f6-88dc-9fb3e26f23d6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:05.971450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f6a25b-df2a-49f6-88dc-9fb3e26f23d6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:06.005821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a6f4-b825-4660-94c1-372450f352b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:06.006520 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a6f4-b825-4660-94c1-372450f352b9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:06.006799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a6f4-b825-4660-94c1-372450f352b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:06.007068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5a6f4-b825-4660-94c1-372450f352b9 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:06.007778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5a6f4-b825-4660-94c1-372450f352b9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:06.008082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5a6f4-b825-4660-94c1-372450f352b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:06.009441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5a6f4-b825-4660-94c1-372450f352b9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:06.019058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 482/993] 10.222.0.79 () {56 vars in 1122 bytes} [Wed May 25 14:30:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:06.020188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18aa0ab-20a2-4d21-b8f5-a5d3d446a60b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:06.122214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18aa0ab-20a2-4d21-b8f5-a5d3d446a60b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:06.134166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:06.159626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c88d1-d67b-4733-9d38-405e89410038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:06.160287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c88d1-d67b-4733-9d38-405e89410038 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:06.160564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c88d1-d67b-4733-9d38-405e89410038 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:06.160832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c88d1-d67b-4733-9d38-405e89410038 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:06.161525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c88d1-d67b-4733-9d38-405e89410038 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:06.161827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c88d1-d67b-4733-9d38-405e89410038 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:06.163250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c88d1-d67b-4733-9d38-405e89410038 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:06.168344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 512/994] 10.222.0.79 () {56 vars in 1122 bytes} [Wed May 25 14:30:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:06.173947 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a6f4-b825-4660-94c1-372450f352b9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:06.182569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:06.275812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5a6f4-b825-4660-94c1-372450f352b9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:06.309588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6b7799-8d55-443d-8d23-730576c20993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:06.310273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7799-8d55-443d-8d23-730576c20993 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:06.310557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7799-8d55-443d-8d23-730576c20993 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:06.310830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6b7799-8d55-443d-8d23-730576c20993 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:06.311620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b7799-8d55-443d-8d23-730576c20993 None admin] RBAC: Adding query filter params (interface=admin, service_id=2b694c32e5034e0eaac5870c65aaf04c, region_id=RegionOne) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:06.311931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b7799-8d55-443d-8d23-730576c20993 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:06.313351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6b7799-8d55-443d-8d23-730576c20993 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:06.322567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 483/995] 10.222.0.79 () {56 vars in 1249 bytes} [Wed May 25 14:30:06 2022] GET /identity/v3/endpoints?service_id=2b694c32e5034e0eaac5870c65aaf04c&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:06.324093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c88d1-d67b-4733-9d38-405e89410038 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:06.423476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c88d1-d67b-4733-9d38-405e89410038 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:06.456816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1d06e-8915-4393-aadf-ae17976eabaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:06.457475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d06e-8915-4393-aadf-ae17976eabaa None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:06.457753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d06e-8915-4393-aadf-ae17976eabaa None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:06.458022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1d06e-8915-4393-aadf-ae17976eabaa None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:06.458714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1d06e-8915-4393-aadf-ae17976eabaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:06.460087 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1d06e-8915-4393-aadf-ae17976eabaa None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:06.474463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 513/996] 10.222.0.79 () {56 vars in 1087 bytes} [Wed May 25 14:30:06 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:30:07.007952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0801d-a043-45eb-9e07-b4ef7dee12d2 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:07.008489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0801d-a043-45eb-9e07-b4ef7dee12d2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:07.008489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0801d-a043-45eb-9e07-b4ef7dee12d2 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:07.010239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 484/997] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:07.015268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1225e-4af5-4594-a8ac-fa3fefb53874 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:07.015646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1225e-4af5-4594-a8ac-fa3fefb53874 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:07.015842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1225e-4af5-4594-a8ac-fa3fefb53874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:07.033565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-aac1225e-4af5-4594-a8ac-fa3fefb53874 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:07.034778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-aac1225e-4af5-4594-a8ac-fa3fefb53874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:07.064003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:07.103273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 514/998] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:07.125297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0801d-a043-45eb-9e07-b4ef7dee12d2 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:07.219147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:07.254834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0801d-a043-45eb-9e07-b4ef7dee12d2 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:07.297423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df6703-28b1-4b5e-b538-73481e7b0090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:07.298338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df6703-28b1-4b5e-b538-73481e7b0090 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:07.298675 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df6703-28b1-4b5e-b538-73481e7b0090 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:07.298955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df6703-28b1-4b5e-b538-73481e7b0090 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:07.299674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df6703-28b1-4b5e-b538-73481e7b0090 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:07.301051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11df6703-28b1-4b5e-b538-73481e7b0090 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-11df6703-28b1-4b5e-b538-73481e7b0090 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:07.313625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:07.314755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:07.315587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 485/999] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:30:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:07.323373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1225e-4af5-4594-a8ac-fa3fefb53874 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:07.431928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1225e-4af5-4594-a8ac-fa3fefb53874 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:07.468039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b535-c371-4675-99b7-3adde6335d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:07.468704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b535-c371-4675-99b7-3adde6335d59 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:07.468987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b535-c371-4675-99b7-3adde6335d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:07.469263 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885b535-c371-4675-99b7-3adde6335d59 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:07.469996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b535-c371-4675-99b7-3adde6335d59 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:07.470327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b535-c371-4675-99b7-3adde6335d59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:07.471712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885b535-c371-4675-99b7-3adde6335d59 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:07.481140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 515/1000] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:30:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:07.482771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df6703-28b1-4b5e-b538-73481e7b0090 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:07.588591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df6703-28b1-4b5e-b538-73481e7b0090 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:07.624325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2c5a2-95a9-4d36-9173-72b6264b9943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:07.625127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2c5a2-95a9-4d36-9173-72b6264b9943 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:07.625418 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2c5a2-95a9-4d36-9173-72b6264b9943 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:07.625697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2c5a2-95a9-4d36-9173-72b6264b9943 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:07.626939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2c5a2-95a9-4d36-9173-72b6264b9943 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:07.627247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2c5a2-95a9-4d36-9173-72b6264b9943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:07.628619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2c5a2-95a9-4d36-9173-72b6264b9943 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:07.629875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:07.639790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 486/1001] 10.222.0.79 () {56 vars in 1112 bytes} [Wed May 25 14:30:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:07.641190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b535-c371-4675-99b7-3adde6335d59 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:07.679887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:07.753007 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885b535-c371-4675-99b7-3adde6335d59 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:07.789694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9d545-0d2d-4889-9eea-242f6c59f9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:07.790371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9d545-0d2d-4889-9eea-242f6c59f9c8 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:07.790652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9d545-0d2d-4889-9eea-242f6c59f9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:07.790921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9d545-0d2d-4889-9eea-242f6c59f9c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:07.791657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9d545-0d2d-4889-9eea-242f6c59f9c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:07.793075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9d545-0d2d-4889-9eea-242f6c59f9c8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:07.818119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 516/1002] 10.222.0.79 () {60 vars in 1144 bytes} [Wed May 25 14:30:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:30:07.872200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7001c-f4b6-4fcb-b34e-638833ad457f None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:07.872525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7001c-f4b6-4fcb-b34e-638833ad457f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:07.872771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7001c-f4b6-4fcb-b34e-638833ad457f None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:07.874268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 487/1003] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:07.880378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f41abe-6725-4859-802a-648946d7db68 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:07.880685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f41abe-6725-4859-802a-648946d7db68 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:07.880938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f41abe-6725-4859-802a-648946d7db68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:07.899084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-60f41abe-6725-4859-802a-648946d7db68 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:07.900280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-60f41abe-6725-4859-802a-648946d7db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:07.985536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 517/1004] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:07 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:08.007282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7001c-f4b6-4fcb-b34e-638833ad457f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:08.119316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7001c-f4b6-4fcb-b34e-638833ad457f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:08.155807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30bb31-0d20-41f4-b59c-85f67a91ec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:08.156606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30bb31-0d20-41f4-b59c-85f67a91ec44 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:08.156890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30bb31-0d20-41f4-b59c-85f67a91ec44 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:08.157695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30bb31-0d20-41f4-b59c-85f67a91ec44 None admin] PATH_INFO: `/v3/services/image` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:08.158389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30bb31-0d20-41f4-b59c-85f67a91ec44 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:08.159761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d30bb31-0d20-41f4-b59c-85f67a91ec44 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-6d30bb31-0d20-41f4-b59c-85f67a91ec44 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:08.171632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:08.173301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:08.174159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 488/1005] 10.222.0.79 () {56 vars in 1105 bytes} [Wed May 25 14:30:08 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:08.182194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f41abe-6725-4859-802a-648946d7db68 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:08.199831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:08.289800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f41abe-6725-4859-802a-648946d7db68 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:08.326877 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55bcb7a-0af3-4e6a-880d-e1df80fae014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:08.327537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bcb7a-0af3-4e6a-880d-e1df80fae014 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:08.327816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bcb7a-0af3-4e6a-880d-e1df80fae014 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:08.328087 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55bcb7a-0af3-4e6a-880d-e1df80fae014 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:08.328790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bcb7a-0af3-4e6a-880d-e1df80fae014 None admin] RBAC: Adding query filter params (name=image) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:08.329092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bcb7a-0af3-4e6a-880d-e1df80fae014 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:08.330507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55bcb7a-0af3-4e6a-880d-e1df80fae014 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:08.335685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 518/1006] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:08.341047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30bb31-0d20-41f4-b59c-85f67a91ec44 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:08.408364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:08.455856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d30bb31-0d20-41f4-b59c-85f67a91ec44 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:08.498916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e67cc-fd2f-4d58-b899-4c515b8ba4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:08.499717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e67cc-fd2f-4d58-b899-4c515b8ba4f4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:08.500003 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e67cc-fd2f-4d58-b899-4c515b8ba4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:08.500272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e67cc-fd2f-4d58-b899-4c515b8ba4f4 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:08.501077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e67cc-fd2f-4d58-b899-4c515b8ba4f4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:08.501380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e67cc-fd2f-4d58-b899-4c515b8ba4f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:08.502864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e67cc-fd2f-4d58-b899-4c515b8ba4f4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:08.514353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 489/1007] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:08.745771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4fbf4-3051-452d-809a-a3f2a221d1ca None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:08.746176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4fbf4-3051-452d-809a-a3f2a221d1ca None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:08.746380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4fbf4-3051-452d-809a-a3f2a221d1ca None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:08.747761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 519/1008] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:08.753344 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8ca45-5fa7-40d5-a14d-a12471a5c8c3 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:08.753643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8ca45-5fa7-40d5-a14d-a12471a5c8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:08.753924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b8ca45-5fa7-40d5-a14d-a12471a5c8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:08.771627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-29b8ca45-5fa7-40d5-a14d-a12471a5c8c3 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:08.772815 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-29b8ca45-5fa7-40d5-a14d-a12471a5c8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:08.846966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 490/1009] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:08 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:08.869728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4fbf4-3051-452d-809a-a3f2a221d1ca None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:08.955792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:08.980482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4fbf4-3051-452d-809a-a3f2a221d1ca None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:09.015434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8263397-d04d-435f-9d67-16817ffda057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:09.016166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8263397-d04d-435f-9d67-16817ffda057 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:09.017004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8263397-d04d-435f-9d67-16817ffda057 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:09.017287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8263397-d04d-435f-9d67-16817ffda057 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:09.017939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8263397-d04d-435f-9d67-16817ffda057 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:09.019370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8263397-d04d-435f-9d67-16817ffda057 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-d8263397-d04d-435f-9d67-16817ffda057 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:09.031528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:09.032461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:09.033352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 520/1010] 10.222.0.79 () {56 vars in 1126 bytes} [Wed May 25 14:30:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:09.038702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8ca45-5fa7-40d5-a14d-a12471a5c8c3 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:09.097942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:09.141967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b8ca45-5fa7-40d5-a14d-a12471a5c8c3 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:09.180130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34464dad-2836-403a-b8ae-63da4d9adb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:09.180789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464dad-2836-403a-b8ae-63da4d9adb8c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:09.181067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464dad-2836-403a-b8ae-63da4d9adb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:09.181336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464dad-2836-403a-b8ae-63da4d9adb8c None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:09.182178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34464dad-2836-403a-b8ae-63da4d9adb8c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:09.182440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34464dad-2836-403a-b8ae-63da4d9adb8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:09.183794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34464dad-2836-403a-b8ae-63da4d9adb8c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:09.190319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 491/1011] 10.222.0.79 () {56 vars in 1122 bytes} [Wed May 25 14:30:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:09.195150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8263397-d04d-435f-9d67-16817ffda057 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:09.300555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8263397-d04d-435f-9d67-16817ffda057 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:09.334833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fba961-9fdc-43cd-89ec-cbf1727d3b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:09.335501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fba961-9fdc-43cd-89ec-cbf1727d3b6f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:09.335783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fba961-9fdc-43cd-89ec-cbf1727d3b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:09.336062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fba961-9fdc-43cd-89ec-cbf1727d3b6f None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:09.336762 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fba961-9fdc-43cd-89ec-cbf1727d3b6f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:09.337068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fba961-9fdc-43cd-89ec-cbf1727d3b6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:09.338477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fba961-9fdc-43cd-89ec-cbf1727d3b6f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:09.347983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 521/1012] 10.222.0.79 () {56 vars in 1122 bytes} [Wed May 25 14:30:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:09.349135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34464dad-2836-403a-b8ae-63da4d9adb8c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:09.452807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34464dad-2836-403a-b8ae-63da4d9adb8c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:09.477843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:09.492180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f77af-5404-49f2-aeff-be37e3ddd7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:09.492911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f77af-5404-49f2-aeff-be37e3ddd7b4 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:09.493258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f77af-5404-49f2-aeff-be37e3ddd7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:09.493600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f77af-5404-49f2-aeff-be37e3ddd7b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:09.494442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f77af-5404-49f2-aeff-be37e3ddd7b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:09.495888 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f77af-5404-49f2-aeff-be37e3ddd7b4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:09.516698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 492/1013] 10.222.0.79 () {60 vars in 1144 bytes} [Wed May 25 14:30:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:30:10.163145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0150d0-b061-40f3-98e7-e58ab981df19 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:10.163520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0150d0-b061-40f3-98e7-e58ab981df19 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:10.163722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0150d0-b061-40f3-98e7-e58ab981df19 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:10.165100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 522/1014] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:10.170331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d689d-9291-44c1-9153-828a46b6252a None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:10.170818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d689d-9291-44c1-9153-828a46b6252a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:10.170898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409d689d-9291-44c1-9153-828a46b6252a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:10.188828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-409d689d-9291-44c1-9153-828a46b6252a None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:10.190010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-409d689d-9291-44c1-9153-828a46b6252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:10.263253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 493/1015] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:10 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:10.286915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0150d0-b061-40f3-98e7-e58ab981df19 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:10.297100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:10.399430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0150d0-b061-40f3-98e7-e58ab981df19 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:10.459384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d9753-52f5-4cee-9715-38a322098411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:10.460120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d9753-52f5-4cee-9715-38a322098411 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:10.460404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d9753-52f5-4cee-9715-38a322098411 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:10.460725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d9753-52f5-4cee-9715-38a322098411 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:10.472062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d9753-52f5-4cee-9715-38a322098411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-6a3d9753-52f5-4cee-9715-38a322098411 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:30:10.480677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:10.481592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:10.482875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 523/1016] 10.222.0.79 () {56 vars in 1120 bytes} [Wed May 25 14:30:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:10.487845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d689d-9291-44c1-9153-828a46b6252a None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:10.605374 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409d689d-9291-44c1-9153-828a46b6252a None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:10.614027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:10.643829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d5ca7-b0c9-4e83-87d2-45611aac6897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:10.645811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d5ca7-b0c9-4e83-87d2-45611aac6897 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:10.645811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d5ca7-b0c9-4e83-87d2-45611aac6897 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:10.645811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d5ca7-b0c9-4e83-87d2-45611aac6897 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:10.645811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d5ca7-b0c9-4e83-87d2-45611aac6897 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:10.646305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d5ca7-b0c9-4e83-87d2-45611aac6897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:10.647488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d5ca7-b0c9-4e83-87d2-45611aac6897 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:10.664242 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 494/1017] 10.222.0.79 () {56 vars in 1115 bytes} [Wed May 25 14:30:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:10.666668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d9753-52f5-4cee-9715-38a322098411 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:10.747099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:10.765362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66da11-3e63-434f-873d-ba8632a7128e None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:10.765870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66da11-3e63-434f-873d-ba8632a7128e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:10.766933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66da11-3e63-434f-873d-ba8632a7128e None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:10.770152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 495/1018] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:30:10.777829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be2df5-b7a0-4d78-b411-7576135494a8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:10.778385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be2df5-b7a0-4d78-b411-7576135494a8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:10.778895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be2df5-b7a0-4d78-b411-7576135494a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:10.798384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d9753-52f5-4cee-9715-38a322098411 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:10.806151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-56be2df5-b7a0-4d78-b411-7576135494a8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:10.807398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-56be2df5-b7a0-4d78-b411-7576135494a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:10.837512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb8652-d908-4b38-b9dd-400d9fb229a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:10.838332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8652-d908-4b38-b9dd-400d9fb229a9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:10.838621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8652-d908-4b38-b9dd-400d9fb229a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:10.838897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb8652-d908-4b38-b9dd-400d9fb229a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:10.855516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb8652-d908-4b38-b9dd-400d9fb229a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:10.856619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb8652-d908-4b38-b9dd-400d9fb229a9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-abbb8652-d908-4b38-b9dd-400d9fb229a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:10.876427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:10.877523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:10.878453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:30:10.878453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:10.878453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:10.878453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:10.878453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 524/1019] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:10.883094 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb8652-d908-4b38-b9dd-400d9fb229a9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:10.891155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 496/1020] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:10 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:10.914741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be2df5-b7a0-4d78-b411-7576135494a8 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:10.993720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb8652-d908-4b38-b9dd-400d9fb229a9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:11.010745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:11.013577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:11.018581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be2df5-b7a0-4d78-b411-7576135494a8 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:11.030822 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b1922-d6c1-47ce-b6e7-fa836639e0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:11.031483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b1922-d6c1-47ce-b6e7-fa836639e0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:11.031857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b1922-d6c1-47ce-b6e7-fa836639e0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:11.032174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b1922-d6c1-47ce-b6e7-fa836639e0a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:11.032808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b1922-d6c1-47ce-b6e7-fa836639e0a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:11.033116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b1922-d6c1-47ce-b6e7-fa836639e0a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:11.034645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b1922-d6c1-47ce-b6e7-fa836639e0a6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:11.051579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 525/1021] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:11.052445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b1922-d6c1-47ce-b6e7-fa836639e0a6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:11.055310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94763e66-1007-489d-a91b-2f21d7d20108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:11.056051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94763e66-1007-489d-a91b-2f21d7d20108 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:11.056338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94763e66-1007-489d-a91b-2f21d7d20108 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:11.056612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94763e66-1007-489d-a91b-2f21d7d20108 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:11.057330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94763e66-1007-489d-a91b-2f21d7d20108 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:11.058739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94763e66-1007-489d-a91b-2f21d7d20108 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:11.078215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 497/1022] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:30:10 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:30:11.174772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b1922-d6c1-47ce-b6e7-fa836639e0a6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:11.221230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b010a3a-ba42-485d-8221-4e70b80bdaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:11.222031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b010a3a-ba42-485d-8221-4e70b80bdaf2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:11.222350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b010a3a-ba42-485d-8221-4e70b80bdaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:11.222629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b010a3a-ba42-485d-8221-4e70b80bdaf2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:11.230680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b010a3a-ba42-485d-8221-4e70b80bdaf2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:11.232198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b010a3a-ba42-485d-8221-4e70b80bdaf2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0b010a3a-ba42-485d-8221-4e70b80bdaf2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:30:11.247930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:11.249012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:11.249931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:11.249931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:11.249931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:30:11.249931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:30:11.249931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:30:11.249931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:30:11.249931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:30:11.249931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:30:11.249931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:30:11.249931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:11.255018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 526/1023] 10.222.0.79 () {56 vars in 1093 bytes} [Wed May 25 14:30:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:11.255448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94763e66-1007-489d-a91b-2f21d7d20108 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:11.368679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94763e66-1007-489d-a91b-2f21d7d20108 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:11.403770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411e6e9-54f1-4974-85a5-d17e1f212467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:11.404452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411e6e9-54f1-4974-85a5-d17e1f212467 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:11.404730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411e6e9-54f1-4974-85a5-d17e1f212467 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:11.405010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5411e6e9-54f1-4974-85a5-d17e1f212467 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:11.405845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411e6e9-54f1-4974-85a5-d17e1f212467 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:11.406188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411e6e9-54f1-4974-85a5-d17e1f212467 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:11.407665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5411e6e9-54f1-4974-85a5-d17e1f212467 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:11.430153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 498/1024] 10.222.0.79 () {56 vars in 1133 bytes} [Wed May 25 14:30:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:11.431954 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b010a3a-ba42-485d-8221-4e70b80bdaf2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:11.468348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:11.538804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b010a3a-ba42-485d-8221-4e70b80bdaf2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:11.574307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9c429-9908-4236-8cec-d5217d694730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:11.574948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9c429-9908-4236-8cec-d5217d694730 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:11.575225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9c429-9908-4236-8cec-d5217d694730 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:11.575497 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9c429-9908-4236-8cec-d5217d694730 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:11.652434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9c429-9908-4236-8cec-d5217d694730 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:11.654280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9c429-9908-4236-8cec-d5217d694730 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:11.689534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:11.766953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 527/1025] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:11 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:30:11.767243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411e6e9-54f1-4974-85a5-d17e1f212467 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:11.787407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:11.820597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9193a-e6e5-4408-892d-59f6ca75e1db None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:11.820899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9193a-e6e5-4408-892d-59f6ca75e1db None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:11.821168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9193a-e6e5-4408-892d-59f6ca75e1db None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:11.822762 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 528/1026] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:30:11.829069 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f35a-e39e-465e-a320-050418901dc6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:11.829351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f35a-e39e-465e-a320-050418901dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:11.829627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0411f35a-e39e-465e-a320-050418901dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:11.848340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0411f35a-e39e-465e-a320-050418901dc6 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:11.849517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0411f35a-e39e-465e-a320-050418901dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:11.905823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5411e6e9-54f1-4974-85a5-d17e1f212467 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:11.934435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 529/1027] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:11.946217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411f35a-e39e-465e-a320-050418901dc6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:11.946547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5936e7d-f6cc-4e48-a112-e471fd454953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:11.947594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5936e7d-f6cc-4e48-a112-e471fd454953 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:11.948082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5936e7d-f6cc-4e48-a112-e471fd454953 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:11.948580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5936e7d-f6cc-4e48-a112-e471fd454953 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:11.959470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5936e7d-f6cc-4e48-a112-e471fd454953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:11.961269 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5936e7d-f6cc-4e48-a112-e471fd454953 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-c5936e7d-f6cc-4e48-a112-e471fd454953 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:11.979859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:11.980714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:11.981581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:30:11.981581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:11.981581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:11.981581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:11.988741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 499/1028] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:11.989858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5936e7d-f6cc-4e48-a112-e471fd454953 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:12.009827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:12.050557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0411f35a-e39e-465e-a320-050418901dc6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:12.065330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:12.088457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12cbd7-8acf-45f6-82ff-41d209dc9e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:12.089252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12cbd7-8acf-45f6-82ff-41d209dc9e9d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:12.089531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12cbd7-8acf-45f6-82ff-41d209dc9e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:12.089808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f12cbd7-8acf-45f6-82ff-41d209dc9e9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:12.091013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12cbd7-8acf-45f6-82ff-41d209dc9e9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:12.092484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f12cbd7-8acf-45f6-82ff-41d209dc9e9d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:12.100113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 530/1029] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:12.101632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12cbd7-8acf-45f6-82ff-41d209dc9e9d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:12.107340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5936e7d-f6cc-4e48-a112-e471fd454953 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:12.145062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d18bc-6306-49d7-8cf6-ac09bcaa677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:12.145601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d18bc-6306-49d7-8cf6-ac09bcaa677f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:12.145944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d18bc-6306-49d7-8cf6-ac09bcaa677f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:12.146652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d18bc-6306-49d7-8cf6-ac09bcaa677f None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:12.147493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d18bc-6306-49d7-8cf6-ac09bcaa677f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:12.147905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d18bc-6306-49d7-8cf6-ac09bcaa677f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:12.149520 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d18bc-6306-49d7-8cf6-ac09bcaa677f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:12.166321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 500/1030] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:12.167248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d18bc-6306-49d7-8cf6-ac09bcaa677f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:12.229645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f12cbd7-8acf-45f6-82ff-41d209dc9e9d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:12.277417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:12.283259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d18bc-6306-49d7-8cf6-ac09bcaa677f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:12.283739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebc015-a737-4bc3-90a8-54d46fe1046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:12.284439 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebc015-a737-4bc3-90a8-54d46fe1046a None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:12.285888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebc015-a737-4bc3-90a8-54d46fe1046a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:12.285888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebc015-a737-4bc3-90a8-54d46fe1046a None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:12.286109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebc015-a737-4bc3-90a8-54d46fe1046a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:12.289690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ebc015-a737-4bc3-90a8-54d46fe1046a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:12.312917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:12.322362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fef90-7bb7-4cb0-b4eb-098c9169c6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:12.323332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fef90-7bb7-4cb0-b4eb-098c9169c6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:12.323693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fef90-7bb7-4cb0-b4eb-098c9169c6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:12.324071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796fef90-7bb7-4cb0-b4eb-098c9169c6b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:12.325995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 531/1031] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:30:12 2022] POST /identity/v3/projects => generated 311 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:30:12.331375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fef90-7bb7-4cb0-b4eb-098c9169c6b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:12.332975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796fef90-7bb7-4cb0-b4eb-098c9169c6b1 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-796fef90-7bb7-4cb0-b4eb-098c9169c6b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:30:12.348972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:12.349948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:12.350899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:30:12.350899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:30:12.350899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:30:12.350899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:30:12.350899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:30:12.350899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:30:12.350899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:30:12.350899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:12.357036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebc015-a737-4bc3-90a8-54d46fe1046a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:12.357379 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 501/1032] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:30:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:12.480903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebc015-a737-4bc3-90a8-54d46fe1046a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:12.524192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c600da-9856-4200-b11b-03fe5af42020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:12.524867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c600da-9856-4200-b11b-03fe5af42020 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:12.525155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c600da-9856-4200-b11b-03fe5af42020 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:12.525433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c600da-9856-4200-b11b-03fe5af42020 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:12.526884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c600da-9856-4200-b11b-03fe5af42020 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:12.526884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c600da-9856-4200-b11b-03fe5af42020 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:12.528000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c600da-9856-4200-b11b-03fe5af42020 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:12.542838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 532/1033] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:30:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:12.549812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fef90-7bb7-4cb0-b4eb-098c9169c6b1 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:12.670515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796fef90-7bb7-4cb0-b4eb-098c9169c6b1 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:12.714108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee80eb-796d-49d0-b0d8-c141757d8b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:12.714108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee80eb-796d-49d0-b0d8-c141757d8b81 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:12.714108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee80eb-796d-49d0-b0d8-c141757d8b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:12.714108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee80eb-796d-49d0-b0d8-c141757d8b81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:12.714526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee80eb-796d-49d0-b0d8-c141757d8b81 None admin] RBAC: Adding query filter params (role.id=eb76f2b0416948d0b129dd08f0ddba37, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=eb66b6f6b5524f3687411fa83d525acc) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:12.714526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee80eb-796d-49d0-b0d8-c141757d8b81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:12.714526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ee80eb-796d-49d0-b0d8-c141757d8b81 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:12.721737 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 502/1034] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:30:12 2022] GET /identity/v3/role_assignments?user.id=eb66b6f6b5524f3687411fa83d525acc&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=eb76f2b0416948d0b129dd08f0ddba37 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:13.335687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976461f5-9670-49de-8df3-882778e71a8c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:13.336037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976461f5-9670-49de-8df3-882778e71a8c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:13.336300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976461f5-9670-49de-8df3-882778e71a8c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:13.337756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 533/1035] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:13.342711 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0244ae1-d395-4018-8014-617001092362 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:13.343138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0244ae1-d395-4018-8014-617001092362 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:13.343335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0244ae1-d395-4018-8014-617001092362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:13.359641 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a0244ae1-d395-4018-8014-617001092362 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:13.361347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a0244ae1-d395-4018-8014-617001092362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:13.409734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:13.431121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 503/1036] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:13 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:13.452930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976461f5-9670-49de-8df3-882778e71a8c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:13.502489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:13.564683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976461f5-9670-49de-8df3-882778e71a8c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:13.601468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fec8-40ce-489e-8127-4c6469b3fda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:13.602268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fec8-40ce-489e-8127-4c6469b3fda9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:13.602574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fec8-40ce-489e-8127-4c6469b3fda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:13.603048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62fec8-40ce-489e-8127-4c6469b3fda9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:13.603740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62fec8-40ce-489e-8127-4c6469b3fda9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:13.605130 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62fec8-40ce-489e-8127-4c6469b3fda9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-9f62fec8-40ce-489e-8127-4c6469b3fda9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:13.618430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:13.619461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:13.620976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 534/1037] 10.222.0.79 () {56 vars in 1105 bytes} [Wed May 25 14:30:13 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:13.625560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0244ae1-d395-4018-8014-617001092362 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:13.726233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0244ae1-d395-4018-8014-617001092362 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:13.759469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1916fe-e8ed-41bb-88da-e0612b2fe0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:13.760380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1916fe-e8ed-41bb-88da-e0612b2fe0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:13.760662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1916fe-e8ed-41bb-88da-e0612b2fe0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:13.760934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1916fe-e8ed-41bb-88da-e0612b2fe0b6 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:13.761635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1916fe-e8ed-41bb-88da-e0612b2fe0b6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:13.761937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1916fe-e8ed-41bb-88da-e0612b2fe0b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:13.763329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1916fe-e8ed-41bb-88da-e0612b2fe0b6 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:13.768960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 504/1038] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:13 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:13.774351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fec8-40ce-489e-8127-4c6469b3fda9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:13.886873 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62fec8-40ce-489e-8127-4c6469b3fda9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:13.896352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:13.927391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5f13d-e264-4a3f-8905-2bb4b2ad706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:13.928058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5f13d-e264-4a3f-8905-2bb4b2ad706b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:13.928344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5f13d-e264-4a3f-8905-2bb4b2ad706b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:13.928621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5f13d-e264-4a3f-8905-2bb4b2ad706b None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:13.929330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5f13d-e264-4a3f-8905-2bb4b2ad706b None admin] RBAC: Adding query filter params (type=image) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:13.929638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5f13d-e264-4a3f-8905-2bb4b2ad706b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:13.931043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de5f13d-e264-4a3f-8905-2bb4b2ad706b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:13.940675 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 535/1039] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:13 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:13.942316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1916fe-e8ed-41bb-88da-e0612b2fe0b6 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:13.991033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:14.050151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1916fe-e8ed-41bb-88da-e0612b2fe0b6 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:14.083967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a94345-5919-4f0b-bafd-14dfcdfabf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:14.084630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a94345-5919-4f0b-bafd-14dfcdfabf21 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:14.084909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a94345-5919-4f0b-bafd-14dfcdfabf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:14.085181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a94345-5919-4f0b-bafd-14dfcdfabf21 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:14.086012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a94345-5919-4f0b-bafd-14dfcdfabf21 None admin] RBAC: Adding query filter params (interface=public, service_id=4a41156fa6c1422783cf75ea388e65ae, region_id=RegionOne) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:14.086348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a94345-5919-4f0b-bafd-14dfcdfabf21 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:14.087789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a94345-5919-4f0b-bafd-14dfcdfabf21 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:14.097973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 505/1040] 10.222.0.79 () {56 vars in 1251 bytes} [Wed May 25 14:30:13 2022] GET /identity/v3/endpoints?service_id=4a41156fa6c1422783cf75ea388e65ae&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:14.099370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5f13d-e264-4a3f-8905-2bb4b2ad706b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:14.202778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5f13d-e264-4a3f-8905-2bb4b2ad706b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:14.239729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5a53f-85e6-4998-96f4-0af43e269ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:14.240401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5a53f-85e6-4998-96f4-0af43e269ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:14.240682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5a53f-85e6-4998-96f4-0af43e269ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:14.240955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5a53f-85e6-4998-96f4-0af43e269ea2 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:14.241638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5a53f-85e6-4998-96f4-0af43e269ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:14.243051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5a53f-85e6-4998-96f4-0af43e269ea2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:14.254009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 536/1041] 10.222.0.79 () {56 vars in 1087 bytes} [Wed May 25 14:30:14 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:30:14.638697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe12b9a-f88c-4ca4-9808-d9971718dfea None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:14.639202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe12b9a-f88c-4ca4-9808-d9971718dfea None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:14.639202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe12b9a-f88c-4ca4-9808-d9971718dfea None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:14.640729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 506/1042] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:14.645906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e651-f17b-4ca4-86bb-7f26eb33045b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:14.646330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e651-f17b-4ca4-86bb-7f26eb33045b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:14.646503 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e02e651-f17b-4ca4-86bb-7f26eb33045b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:14.663621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4e02e651-f17b-4ca4-86bb-7f26eb33045b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:14.664808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4e02e651-f17b-4ca4-86bb-7f26eb33045b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:14.694525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:14.735570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 537/1043] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:14.761061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe12b9a-f88c-4ca4-9808-d9971718dfea None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:14.867967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe12b9a-f88c-4ca4-9808-d9971718dfea None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:14.880076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:14.904861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0f318-8458-4a58-9e75-cd2d665b0205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:14.905665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f318-8458-4a58-9e75-cd2d665b0205 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:14.905948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f318-8458-4a58-9e75-cd2d665b0205 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:14.906275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0f318-8458-4a58-9e75-cd2d665b0205 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:14.907991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0f318-8458-4a58-9e75-cd2d665b0205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:14.909432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0f318-8458-4a58-9e75-cd2d665b0205 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:14.911306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 507/1044] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:14.916758 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02e651-f17b-4ca4-86bb-7f26eb33045b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:14.919525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371b0a-351a-4243-8877-6820477414f1 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:14.919810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371b0a-351a-4243-8877-6820477414f1 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:14.920088 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48371b0a-351a-4243-8877-6820477414f1 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:14.921406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 508/1045] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:14.926270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8966-3d04-45d2-9e17-fea4fedf8e6a None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:14.926556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8966-3d04-45d2-9e17-fea4fedf8e6a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:14.926832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b8966-3d04-45d2-9e17-fea4fedf8e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:14.946747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-363b8966-3d04-45d2-9e17-fea4fedf8e6a None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:14.947912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-363b8966-3d04-45d2-9e17-fea4fedf8e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:15.023173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 509/1046] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:30:15.030997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e02e651-f17b-4ca4-86bb-7f26eb33045b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:15.044528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b8966-3d04-45d2-9e17-fea4fedf8e6a None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:15.066964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ec7ca-0b88-49e3-a261-658d84bac6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:15.067639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ec7ca-0b88-49e3-a261-658d84bac6ad None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:15.067922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ec7ca-0b88-49e3-a261-658d84bac6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:15.068197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ec7ca-0b88-49e3-a261-658d84bac6ad None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:15.068919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ec7ca-0b88-49e3-a261-658d84bac6ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:15.070467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ec7ca-0b88-49e3-a261-658d84bac6ad None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:15.098230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 538/1047] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:30:14 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:30:15.152481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b8966-3d04-45d2-9e17-fea4fedf8e6a None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:15.163625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:15.192243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce46a9-91d6-4171-9b2d-da64768ba0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:15.193712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce46a9-91d6-4171-9b2d-da64768ba0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:15.193712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce46a9-91d6-4171-9b2d-da64768ba0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:15.193712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce46a9-91d6-4171-9b2d-da64768ba0c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:15.208430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce46a9-91d6-4171-9b2d-da64768ba0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-d5ce46a9-91d6-4171-9b2d-da64768ba0c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:30:15.217151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:15.218467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:15.224562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 510/1048] 10.222.0.79 () {56 vars in 1120 bytes} [Wed May 25 14:30:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:15.226605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ec7ca-0b88-49e3-a261-658d84bac6ad None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:15.254563 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:15.344423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ec7ca-0b88-49e3-a261-658d84bac6ad None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:15.382990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8906358-20b7-4997-980f-c859ea65ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:15.383665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8906358-20b7-4997-980f-c859ea65ecde None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:15.383945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8906358-20b7-4997-980f-c859ea65ecde None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:15.384222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8906358-20b7-4997-980f-c859ea65ecde None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:15.385241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8906358-20b7-4997-980f-c859ea65ecde None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:15.385549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8906358-20b7-4997-980f-c859ea65ecde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:15.386966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8906358-20b7-4997-980f-c859ea65ecde None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:15.395556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 539/1049] 10.222.0.79 () {56 vars in 1115 bytes} [Wed May 25 14:30:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:15.401423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce46a9-91d6-4171-9b2d-da64768ba0c7 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:15.506252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce46a9-91d6-4171-9b2d-da64768ba0c7 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:15.544569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a193212-0ac8-4fcb-af7a-dde68072001e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:15.545368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193212-0ac8-4fcb-af7a-dde68072001e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:15.545646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193212-0ac8-4fcb-af7a-dde68072001e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:15.545917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a193212-0ac8-4fcb-af7a-dde68072001e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:15.557302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a193212-0ac8-4fcb-af7a-dde68072001e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:15.558763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a193212-0ac8-4fcb-af7a-dde68072001e None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-1a193212-0ac8-4fcb-af7a-dde68072001e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:15.576560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:15.577426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:15.578918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:30:15.578918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:15.578918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:15.578918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:15.579336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 511/1050] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:15.583672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8906358-20b7-4997-980f-c859ea65ecde None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:15.675283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:15.691853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8906358-20b7-4997-980f-c859ea65ecde None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:15.725803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe897c3-1319-4658-98a7-bb0ae54fc104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:15.726491 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe897c3-1319-4658-98a7-bb0ae54fc104 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:15.726771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe897c3-1319-4658-98a7-bb0ae54fc104 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:15.727044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe897c3-1319-4658-98a7-bb0ae54fc104 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:15.728784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe897c3-1319-4658-98a7-bb0ae54fc104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:15.728784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe897c3-1319-4658-98a7-bb0ae54fc104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:15.729774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe897c3-1319-4658-98a7-bb0ae54fc104 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:15.743760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 540/1051] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:15.749335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a193212-0ac8-4fcb-af7a-dde68072001e None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:15.774059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:15.858414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a193212-0ac8-4fcb-af7a-dde68072001e None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:15.894253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b99a-3035-496b-9ad1-7fb5b0711ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:15.895059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b99a-3035-496b-9ad1-7fb5b0711ca6 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:15.895357 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b99a-3035-496b-9ad1-7fb5b0711ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:15.895625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b99a-3035-496b-9ad1-7fb5b0711ca6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:15.903381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b99a-3035-496b-9ad1-7fb5b0711ca6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:15.904825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b99a-3035-496b-9ad1-7fb5b0711ca6 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-2b98b99a-3035-496b-9ad1-7fb5b0711ca6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:30:15.919028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:15.919966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:15.921061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 512/1052] 10.222.0.79 () {56 vars in 1093 bytes} [Wed May 25 14:30:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:15.927303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe897c3-1319-4658-98a7-bb0ae54fc104 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:16.036872 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe897c3-1319-4658-98a7-bb0ae54fc104 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:16.074820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a66c04-e43e-4d86-b8fe-71730e3e4347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:16.075493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a66c04-e43e-4d86-b8fe-71730e3e4347 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:16.075779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a66c04-e43e-4d86-b8fe-71730e3e4347 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:16.076057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a66c04-e43e-4d86-b8fe-71730e3e4347 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:16.076891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a66c04-e43e-4d86-b8fe-71730e3e4347 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:16.077203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a66c04-e43e-4d86-b8fe-71730e3e4347 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:16.078729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a66c04-e43e-4d86-b8fe-71730e3e4347 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:16.100270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 541/1053] 10.222.0.79 () {56 vars in 1133 bytes} [Wed May 25 14:30:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:16.101619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b99a-3035-496b-9ad1-7fb5b0711ca6 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:16.183575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:16.202580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b99a-3035-496b-9ad1-7fb5b0711ca6 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:16.236948 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4a266-3116-4345-8d5a-04dddac15a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:16.237745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a266-3116-4345-8d5a-04dddac15a8f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:16.238028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a266-3116-4345-8d5a-04dddac15a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:16.238329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4a266-3116-4345-8d5a-04dddac15a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:16.249105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4a266-3116-4345-8d5a-04dddac15a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:16.250616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4a266-3116-4345-8d5a-04dddac15a8f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-0ad4a266-3116-4345-8d5a-04dddac15a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:16.269441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:16.270460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:16.271341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:30:16.271341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:16.271341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:16.271341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:16.272249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 513/1054] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:16.276705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a66c04-e43e-4d86-b8fe-71730e3e4347 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:16.279808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:16.389381 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a66c04-e43e-4d86-b8fe-71730e3e4347 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:16.425506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9a19eb-ad72-4ce1-8088-c812c732601f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:16.426191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a19eb-ad72-4ce1-8088-c812c732601f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:16.426478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a19eb-ad72-4ce1-8088-c812c732601f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:16.426757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9a19eb-ad72-4ce1-8088-c812c732601f None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:16.427478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a19eb-ad72-4ce1-8088-c812c732601f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:16.427792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a19eb-ad72-4ce1-8088-c812c732601f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:16.429174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9a19eb-ad72-4ce1-8088-c812c732601f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:16.445490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 542/1055] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:16.447248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4a266-3116-4345-8d5a-04dddac15a8f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:16.466419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f65778-2e23-4b67-9dbd-2464a560a6cc None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:16.466698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f65778-2e23-4b67-9dbd-2464a560a6cc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:16.466973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f65778-2e23-4b67-9dbd-2464a560a6cc None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:16.468314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 543/1056] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:16.473027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd8024-e3d7-4a57-aa78-14551ccdbfa9 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:16.473315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd8024-e3d7-4a57-aa78-14551ccdbfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:16.473591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd8024-e3d7-4a57-aa78-14551ccdbfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:16.494776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6cfd8024-e3d7-4a57-aa78-14551ccdbfa9 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:16.496298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6cfd8024-e3d7-4a57-aa78-14551ccdbfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:16.556618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:16.560682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4a266-3116-4345-8d5a-04dddac15a8f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:16.575786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 544/1057] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:16 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:30:16.592423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd8024-e3d7-4a57-aa78-14551ccdbfa9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:16.601234 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:16.608227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1df09-7714-43e0-9840-16f40f6196c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:16.609191 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1df09-7714-43e0-9840-16f40f6196c8 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:16.609475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1df09-7714-43e0-9840-16f40f6196c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:16.609829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1df09-7714-43e0-9840-16f40f6196c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:16.617055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1df09-7714-43e0-9840-16f40f6196c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:16.618545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1df09-7714-43e0-9840-16f40f6196c8 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-d0e1df09-7714-43e0-9840-16f40f6196c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:30:16.632649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:16.633518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:16.634807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:30:16.634807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:30:16.634807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:30:16.634807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:30:16.634807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:30:16.634807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:30:16.634807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:30:16.634807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:16.634807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 514/1058] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:30:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:16.639687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1df09-7714-43e0-9840-16f40f6196c8 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:16.711907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd8024-e3d7-4a57-aa78-14551ccdbfa9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:16.747945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1df09-7714-43e0-9840-16f40f6196c8 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:16.749822 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e69fe-e8db-4f20-8323-34ce97b3c579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:16.750661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e69fe-e8db-4f20-8323-34ce97b3c579 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:16.750936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e69fe-e8db-4f20-8323-34ce97b3c579 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:16.751209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007e69fe-e8db-4f20-8323-34ce97b3c579 None admin] PATH_INFO: `/v3/services/image` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:16.751852 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e69fe-e8db-4f20-8323-34ce97b3c579 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:16.753219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007e69fe-e8db-4f20-8323-34ce97b3c579 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-007e69fe-e8db-4f20-8323-34ce97b3c579 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:16.765058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:16.766607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:16.767606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 545/1059] 10.222.0.79 () {56 vars in 1105 bytes} [Wed May 25 14:30:16 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:16.772562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e69fe-e8db-4f20-8323-34ce97b3c579 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:16.787199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e93ef1-d339-4a1f-adee-e477943cb9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:16.787918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e93ef1-d339-4a1f-adee-e477943cb9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:16.788202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e93ef1-d339-4a1f-adee-e477943cb9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:16.788472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e93ef1-d339-4a1f-adee-e477943cb9a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:16.789300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e93ef1-d339-4a1f-adee-e477943cb9a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:16.789610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e93ef1-d339-4a1f-adee-e477943cb9a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:16.791072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e93ef1-d339-4a1f-adee-e477943cb9a0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:16.805302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 515/1060] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:30:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:16.810723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e93ef1-d339-4a1f-adee-e477943cb9a0 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:16.834456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:16.873778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:16.883973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007e69fe-e8db-4f20-8323-34ce97b3c579 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:16.927189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701f151-f2b1-4396-b0f7-a778830d233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:16.928016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e93ef1-d339-4a1f-adee-e477943cb9a0 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:16.928482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f151-f2b1-4396-b0f7-a778830d233a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:16.928970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f151-f2b1-4396-b0f7-a778830d233a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:16.929461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701f151-f2b1-4396-b0f7-a778830d233a None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:16.930305 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701f151-f2b1-4396-b0f7-a778830d233a None admin] RBAC: Adding query filter params (name=image) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:16.931187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701f151-f2b1-4396-b0f7-a778830d233a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:16.932150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701f151-f2b1-4396-b0f7-a778830d233a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:16.937714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 546/1061] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:16.943441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701f151-f2b1-4396-b0f7-a778830d233a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:16.965277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22562e1-dbe8-4728-82ff-d295375be930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:16.966298 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22562e1-dbe8-4728-82ff-d295375be930 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:16.966650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22562e1-dbe8-4728-82ff-d295375be930 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:16.966995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22562e1-dbe8-4728-82ff-d295375be930 None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/eb66b6f6b5524f3687411fa83d525acc/roles/eb76f2b0416948d0b129dd08f0ddba37` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:16.969965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22562e1-dbe8-4728-82ff-d295375be930 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=eb66b6f6b5524f3687411fa83d525acc, role_id=eb76f2b0416948d0b129dd08f0ddba37)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:16.971438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22562e1-dbe8-4728-82ff-d295375be930 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:16.984997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 516/1062] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:30:16 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/eb66b6f6b5524f3687411fa83d525acc/roles/eb76f2b0416948d0b129dd08f0ddba37 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:30:17.059278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701f151-f2b1-4396-b0f7-a778830d233a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:17.080954 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:17.097371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9eb62-b62a-4dc0-962f-89b3e2030d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:17.098052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9eb62-b62a-4dc0-962f-89b3e2030d90 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:17.098362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9eb62-b62a-4dc0-962f-89b3e2030d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:17.098635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9eb62-b62a-4dc0-962f-89b3e2030d90 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:17.099347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9eb62-b62a-4dc0-962f-89b3e2030d90 None admin] RBAC: Adding query filter params (type=image) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:17.099653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9eb62-b62a-4dc0-962f-89b3e2030d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:17.101170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9eb62-b62a-4dc0-962f-89b3e2030d90 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:17.111974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 547/1063] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:17.114580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22562e1-dbe8-4728-82ff-d295375be930 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:17.227313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22562e1-dbe8-4728-82ff-d295375be930 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:17.241743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:17.265961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9250c6-d638-4955-ad4a-9be6d88f3063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:17.266702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9250c6-d638-4955-ad4a-9be6d88f3063 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:17.266989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9250c6-d638-4955-ad4a-9be6d88f3063 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:17.267266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9250c6-d638-4955-ad4a-9be6d88f3063 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:17.268001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9250c6-d638-4955-ad4a-9be6d88f3063 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:17.269355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9250c6-d638-4955-ad4a-9be6d88f3063 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:17.289975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 517/1064] 10.222.0.79 () {60 vars in 1144 bytes} [Wed May 25 14:30:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:30:17.403223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20292f-a60e-41fc-b70d-edf2d554374b None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:17.403559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20292f-a60e-41fc-b70d-edf2d554374b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:17.403779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20292f-a60e-41fc-b70d-edf2d554374b None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:17.405302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 548/1065] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:17.411355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6de8b-e97d-4d2e-bc7b-525297891550 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:17.411641 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6de8b-e97d-4d2e-bc7b-525297891550 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:17.411920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6de8b-e97d-4d2e-bc7b-525297891550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:17.430023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-06b6de8b-e97d-4d2e-bc7b-525297891550 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:17.431259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-06b6de8b-e97d-4d2e-bc7b-525297891550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:17.522813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 518/1066] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:17.547644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20292f-a60e-41fc-b70d-edf2d554374b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:17.649891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20292f-a60e-41fc-b70d-edf2d554374b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:17.688364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be23cc-25dd-4693-8706-d403c98211fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:17.689161 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be23cc-25dd-4693-8706-d403c98211fb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:17.689442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be23cc-25dd-4693-8706-d403c98211fb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:17.689715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be23cc-25dd-4693-8706-d403c98211fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:17.700021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be23cc-25dd-4693-8706-d403c98211fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-43be23cc-25dd-4693-8706-d403c98211fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:30:17.708282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:17.709181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:17.709993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:17.711361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 549/1067] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:30:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:17.715615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6de8b-e97d-4d2e-bc7b-525297891550 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:17.819091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:17.827026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6de8b-e97d-4d2e-bc7b-525297891550 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:17.869209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fd923-3904-42a3-888d-deb9770c9d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:17.869882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd923-3904-42a3-888d-deb9770c9d93 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:17.870192 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd923-3904-42a3-888d-deb9770c9d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:17.870565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd923-3904-42a3-888d-deb9770c9d93 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:17.871318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fd923-3904-42a3-888d-deb9770c9d93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:17.871623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fd923-3904-42a3-888d-deb9770c9d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:17.872988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fd923-3904-42a3-888d-deb9770c9d93 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:17.882330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 519/1068] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:30:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:17.888053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be23cc-25dd-4693-8706-d403c98211fb None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:17.939997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:17.998506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be23cc-25dd-4693-8706-d403c98211fb None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:18.032504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436840b-a2eb-4b72-975f-64501213b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:18.033378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436840b-a2eb-4b72-975f-64501213b9bb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:18.033660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436840b-a2eb-4b72-975f-64501213b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:18.033935 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436840b-a2eb-4b72-975f-64501213b9bb None admin] PATH_INFO: `/v3/users/a1d453c02ad54b369da5dc4ca7af4169` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:18.047407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436840b-a2eb-4b72-975f-64501213b9bb None admin] RBAC: Authorizing `identity:get_user(user_id=a1d453c02ad54b369da5dc4ca7af4169)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:18.048864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436840b-a2eb-4b72-975f-64501213b9bb None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:18.050792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 550/1069] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:17 2022] GET /identity/v3/users/a1d453c02ad54b369da5dc4ca7af4169 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:18.056173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fd923-3904-42a3-888d-deb9770c9d93 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:18.165384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fd923-3904-42a3-888d-deb9770c9d93 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:18.202499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85080e75-75ba-4673-9b2e-0085ab396748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:18.203154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080e75-75ba-4673-9b2e-0085ab396748 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:18.203486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080e75-75ba-4673-9b2e-0085ab396748 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:18.204279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080e75-75ba-4673-9b2e-0085ab396748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:18.228805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:18.273120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85080e75-75ba-4673-9b2e-0085ab396748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:18.274616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85080e75-75ba-4673-9b2e-0085ab396748 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:18.377294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 520/1070] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:30:18.383045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436840b-a2eb-4b72-975f-64501213b9bb None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:18.490053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436840b-a2eb-4b72-975f-64501213b9bb None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:18.491624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:18.532663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdde9a8-4f64-48cc-b042-f34e3d922dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:18.533628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde9a8-4f64-48cc-b042-f34e3d922dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:18.533914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde9a8-4f64-48cc-b042-f34e3d922dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:18.534221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdde9a8-4f64-48cc-b042-f34e3d922dc1 None admin] PATH_INFO: `/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:18.535404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdde9a8-4f64-48cc-b042-f34e3d922dc1 None admin] RBAC: Authorizing `identity:get_project(project_id=6a7ab7c02f674f0caa76e5d75f49547a)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:18.536842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdde9a8-4f64-48cc-b042-f34e3d922dc1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:18.543376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 551/1071] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:30:18 2022] GET /identity/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:18.544605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85080e75-75ba-4673-9b2e-0085ab396748 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:18.600645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:18.651591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85080e75-75ba-4673-9b2e-0085ab396748 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:18.686826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cf55f-31e8-462d-86d5-80dc585c1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:18.687478 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cf55f-31e8-462d-86d5-80dc585c1cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:18.687783 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cf55f-31e8-462d-86d5-80dc585c1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:18.688058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cf55f-31e8-462d-86d5-80dc585c1cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:18.688886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cf55f-31e8-462d-86d5-80dc585c1cc0 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=6a7ab7c02f674f0caa76e5d75f49547a, user.id=a1d453c02ad54b369da5dc4ca7af4169) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:18.689195 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cf55f-31e8-462d-86d5-80dc585c1cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:18.690680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cf55f-31e8-462d-86d5-80dc585c1cc0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:18.702319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 521/1072] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:30:18 2022] GET /identity/v3/role_assignments?user.id=a1d453c02ad54b369da5dc4ca7af4169&scope.project.id=6a7ab7c02f674f0caa76e5d75f49547a&role.id=308d9785120a49079e02659953a2b033 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:19.224224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776949a0-d1e3-440b-b3e2-b4ccecc847e3 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:19.224741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776949a0-d1e3-440b-b3e2-b4ccecc847e3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:19.224819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776949a0-d1e3-440b-b3e2-b4ccecc847e3 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:19.226264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 552/1073] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:19.231226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b73c0-ccd8-48c4-9a1f-60bc7cb547a5 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:19.231601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b73c0-ccd8-48c4-9a1f-60bc7cb547a5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:19.231768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b73c0-ccd8-48c4-9a1f-60bc7cb547a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:19.248545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-cb8b73c0-ccd8-48c4-9a1f-60bc7cb547a5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:19.250052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-cb8b73c0-ccd8-48c4-9a1f-60bc7cb547a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:19.321106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 522/1074] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:19.348798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776949a0-d1e3-440b-b3e2-b4ccecc847e3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:19.453613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776949a0-d1e3-440b-b3e2-b4ccecc847e3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:19.492670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d8aa5-29cf-4464-8e39-ff81549a9d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:19.493545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d8aa5-29cf-4464-8e39-ff81549a9d62 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:19.493898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d8aa5-29cf-4464-8e39-ff81549a9d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:19.494277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9d8aa5-29cf-4464-8e39-ff81549a9d62 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:19.505855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9d8aa5-29cf-4464-8e39-ff81549a9d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:30:19.510632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691da9c-47d8-4229-894c-7048b669a5bc None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:19.510926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691da9c-47d8-4229-894c-7048b669a5bc None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:19.511213 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691da9c-47d8-4229-894c-7048b669a5bc None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:19.514141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 523/1075] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-8a9d8aa5-29cf-4464-8e39-ff81549a9d62 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:30:19.516734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:19.518875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 14:30:19.520977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:19.522555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece96b7-9f12-4070-b19a-a716c3f6e5f2 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:19.522555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece96b7-9f12-4070-b19a-a716c3f6e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:19.522555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece96b7-9f12-4070-b19a-a716c3f6e5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:19.523532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 553/1076] 10.222.0.79 () {56 vars in 1120 bytes} [Wed May 25 14:30:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:19.524370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d8aa5-29cf-4464-8e39-ff81549a9d62 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:19.537555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-3ece96b7-9f12-4070-b19a-a716c3f6e5f2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:19.539036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3ece96b7-9f12-4070-b19a-a716c3f6e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:19.560198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:19.590712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:19.618135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 524/1077] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:30:19.638243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece96b7-9f12-4070-b19a-a716c3f6e5f2 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:19.649131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9d8aa5-29cf-4464-8e39-ff81549a9d62 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:19.689464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d5fdc-1356-4e46-b955-c72c5afa3e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:19.690152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d5fdc-1356-4e46-b955-c72c5afa3e89 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:19.690440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d5fdc-1356-4e46-b955-c72c5afa3e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:19.690710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d5fdc-1356-4e46-b955-c72c5afa3e89 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:19.691450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d5fdc-1356-4e46-b955-c72c5afa3e89 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:19.691768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d5fdc-1356-4e46-b955-c72c5afa3e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:19.693114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d5fdc-1356-4e46-b955-c72c5afa3e89 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:19.701115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 554/1078] 10.222.0.79 () {56 vars in 1115 bytes} [Wed May 25 14:30:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:19.706673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d5fdc-1356-4e46-b955-c72c5afa3e89 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:19.744013 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece96b7-9f12-4070-b19a-a716c3f6e5f2 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:19.778130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72992fbf-82eb-4b61-b36c-1c98641b3e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:19.778858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72992fbf-82eb-4b61-b36c-1c98641b3e53 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:19.779143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72992fbf-82eb-4b61-b36c-1c98641b3e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:19.779433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72992fbf-82eb-4b61-b36c-1c98641b3e53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:19.810540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:19.820562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d5fdc-1356-4e46-b955-c72c5afa3e89 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:19.835312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:19.860791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72992fbf-82eb-4b61-b36c-1c98641b3e53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:19.862511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72992fbf-82eb-4b61-b36c-1c98641b3e53 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:19.866935 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255ce7-fc0f-44fa-9408-1e349fd0bb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:19.867803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255ce7-fc0f-44fa-9408-1e349fd0bb90 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:19.868171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255ce7-fc0f-44fa-9408-1e349fd0bb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:19.868513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8255ce7-fc0f-44fa-9408-1e349fd0bb90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:19.879662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8255ce7-fc0f-44fa-9408-1e349fd0bb90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:19.881106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8255ce7-fc0f-44fa-9408-1e349fd0bb90 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f8255ce7-fc0f-44fa-9408-1e349fd0bb90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:19.902247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:19.903172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:19.904049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:30:19.904049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:19.904049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:19.904049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:19.904049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 555/1079] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:19.909470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255ce7-fc0f-44fa-9408-1e349fd0bb90 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:19.975563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 525/1080] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 14:30:19.981085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72992fbf-82eb-4b61-b36c-1c98641b3e53 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:20.019742 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8255ce7-fc0f-44fa-9408-1e349fd0bb90 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:20.054279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449d6de-7812-4de4-a7f5-49117be7ebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:20.054933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d6de-7812-4de4-a7f5-49117be7ebcc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:20.055213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d6de-7812-4de4-a7f5-49117be7ebcc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:20.055483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d449d6de-7812-4de4-a7f5-49117be7ebcc None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:20.056196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449d6de-7812-4de4-a7f5-49117be7ebcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:20.056497 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449d6de-7812-4de4-a7f5-49117be7ebcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:20.057863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d449d6de-7812-4de4-a7f5-49117be7ebcc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:20.067607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:20.070004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 556/1081] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:20.075615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449d6de-7812-4de4-a7f5-49117be7ebcc None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:20.080194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:20.091774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72992fbf-82eb-4b61-b36c-1c98641b3e53 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:20.130503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17593ff2-892f-46f4-b008-7d1cb9839e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:20.131685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17593ff2-892f-46f4-b008-7d1cb9839e58 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:20.132144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17593ff2-892f-46f4-b008-7d1cb9839e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:20.132589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17593ff2-892f-46f4-b008-7d1cb9839e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:20.144296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17593ff2-892f-46f4-b008-7d1cb9839e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:20.146061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17593ff2-892f-46f4-b008-7d1cb9839e58 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-17593ff2-892f-46f4-b008-7d1cb9839e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:20.164755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:20.165768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:20.170895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:30:20.170895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:20.170895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:20.170895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:20.170895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 526/1082] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:20.172112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17593ff2-892f-46f4-b008-7d1cb9839e58 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:20.188954 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d449d6de-7812-4de4-a7f5-49117be7ebcc None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:20.228963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f084b-3dcc-4bea-932e-56d2e08dfcd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:20.229809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f084b-3dcc-4bea-932e-56d2e08dfcd3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:20.230075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f084b-3dcc-4bea-932e-56d2e08dfcd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:20.230383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734f084b-3dcc-4bea-932e-56d2e08dfcd3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:20.238641 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f084b-3dcc-4bea-932e-56d2e08dfcd3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:20.240136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734f084b-3dcc-4bea-932e-56d2e08dfcd3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-734f084b-3dcc-4bea-932e-56d2e08dfcd3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:30:20.254458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:20.255396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:20.256537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 557/1083] 10.222.0.79 () {56 vars in 1093 bytes} [Wed May 25 14:30:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:20.261407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f084b-3dcc-4bea-932e-56d2e08dfcd3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:20.279472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17593ff2-892f-46f4-b008-7d1cb9839e58 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:20.309803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:20.318843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1f7c8-a300-4320-9213-90bb226c1fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:20.319519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1f7c8-a300-4320-9213-90bb226c1fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:20.319803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1f7c8-a300-4320-9213-90bb226c1fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:20.320078 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1f7c8-a300-4320-9213-90bb226c1fa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:20.320799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1f7c8-a300-4320-9213-90bb226c1fa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:20.321104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1f7c8-a300-4320-9213-90bb226c1fa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:20.322596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1f7c8-a300-4320-9213-90bb226c1fa5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:20.329200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:20.335050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 527/1084] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:20.381291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734f084b-3dcc-4bea-932e-56d2e08dfcd3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:20.419129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b7aec-72dc-48c4-9b2b-d3e7e60eb157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:20.421049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b7aec-72dc-48c4-9b2b-d3e7e60eb157 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:20.421049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b7aec-72dc-48c4-9b2b-d3e7e60eb157 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:20.421049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194b7aec-72dc-48c4-9b2b-d3e7e60eb157 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:20.422118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b7aec-72dc-48c4-9b2b-d3e7e60eb157 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:20.422118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b7aec-72dc-48c4-9b2b-d3e7e60eb157 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:20.423990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194b7aec-72dc-48c4-9b2b-d3e7e60eb157 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:20.444885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 558/1085] 10.222.0.79 () {56 vars in 1133 bytes} [Wed May 25 14:30:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:20.450901 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1f7c8-a300-4320-9213-90bb226c1fa5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:20.565227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1f7c8-a300-4320-9213-90bb226c1fa5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:20.600219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387a3ac6-8abb-4cca-9d24-b4663182c9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:20.601001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a3ac6-8abb-4cca-9d24-b4663182c9ee None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:20.601318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a3ac6-8abb-4cca-9d24-b4663182c9ee None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:20.601694 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387a3ac6-8abb-4cca-9d24-b4663182c9ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:20.672722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:20.682956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a3ac6-8abb-4cca-9d24-b4663182c9ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:20.684420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387a3ac6-8abb-4cca-9d24-b4663182c9ee None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:20.787407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 528/1086] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:30:20.793463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b7aec-72dc-48c4-9b2b-d3e7e60eb157 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:20.895144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194b7aec-72dc-48c4-9b2b-d3e7e60eb157 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:20.909857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447b97-eac0-4395-82c9-ff24d6e86b83 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:20.910247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447b97-eac0-4395-82c9-ff24d6e86b83 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:20.910527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447b97-eac0-4395-82c9-ff24d6e86b83 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:20.911900 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 529/1087] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:30:20.916788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8266-e45a-40a8-ba1a-129b9b0b1dc6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:20.917068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8266-e45a-40a8-ba1a-129b9b0b1dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:20.917338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c8266-e45a-40a8-ba1a-129b9b0b1dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:20.918627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:20.931291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2eabeb-3d33-4570-afe8-70d60322539f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:20.932116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2eabeb-3d33-4570-afe8-70d60322539f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:20.932399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2eabeb-3d33-4570-afe8-70d60322539f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:20.932674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2eabeb-3d33-4570-afe8-70d60322539f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:20.933598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-2c9c8266-e45a-40a8-ba1a-129b9b0b1dc6 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:20.934798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-2c9c8266-e45a-40a8-ba1a-129b9b0b1dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:20.943161 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2eabeb-3d33-4570-afe8-70d60322539f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:20.944605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2eabeb-3d33-4570-afe8-70d60322539f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-7e2eabeb-3d33-4570-afe8-70d60322539f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:20.964473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:20.965393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:20.966492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:30:20.966492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:20.966492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:30:20.966492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:20.966492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 559/1088] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:20.971736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2eabeb-3d33-4570-afe8-70d60322539f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:21.005044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 530/1089] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:30:21.027323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c8266-e45a-40a8-ba1a-129b9b0b1dc6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:21.049400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:21.071483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2eabeb-3d33-4570-afe8-70d60322539f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:21.105674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce433c70-6caf-42c8-920e-73d7790ae1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:21.106289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433c70-6caf-42c8-920e-73d7790ae1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:21.106580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433c70-6caf-42c8-920e-73d7790ae1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:21.106861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce433c70-6caf-42c8-920e-73d7790ae1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:21.107597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce433c70-6caf-42c8-920e-73d7790ae1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:21.107887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce433c70-6caf-42c8-920e-73d7790ae1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:21.109259 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce433c70-6caf-42c8-920e-73d7790ae1f0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:21.120493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 560/1090] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:21.126492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce433c70-6caf-42c8-920e-73d7790ae1f0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:21.128298 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c8266-e45a-40a8-ba1a-129b9b0b1dc6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:21.159925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:21.161787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b45cd-24b3-480d-abd3-4dee9e2093a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:21.162517 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b45cd-24b3-480d-abd3-4dee9e2093a5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:21.162817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b45cd-24b3-480d-abd3-4dee9e2093a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:21.163070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b45cd-24b3-480d-abd3-4dee9e2093a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:21.174001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b45cd-24b3-480d-abd3-4dee9e2093a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-807b45cd-24b3-480d-abd3-4dee9e2093a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:30:21.181696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:21.182693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:21.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 531/1091] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:30:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:21.189252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b45cd-24b3-480d-abd3-4dee9e2093a5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:21.227224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce433c70-6caf-42c8-920e-73d7790ae1f0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:21.259612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4d42d-bc46-4d74-befe-e7617679cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:21.260646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4d42d-bc46-4d74-befe-e7617679cf35 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:21.260924 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4d42d-bc46-4d74-befe-e7617679cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:21.261192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4d42d-bc46-4d74-befe-e7617679cf35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:21.268307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4d42d-bc46-4d74-befe-e7617679cf35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:21.269269 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:21.269738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4d42d-bc46-4d74-befe-e7617679cf35 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-5ab4d42d-bc46-4d74-befe-e7617679cf35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:30:21.285111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:21.286257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:21.287811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:30:21.287811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:30:21.287811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:30:21.287811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:30:21.287811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:30:21.287811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:30:21.287811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:30:21.287811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:21.287811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 561/1092] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:30:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:30:21.292097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4d42d-bc46-4d74-befe-e7617679cf35 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:21.292228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b45cd-24b3-480d-abd3-4dee9e2093a5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:21.325643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed10d4e-c7d8-4c24-bb2a-147c5af0e7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:21.326336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed10d4e-c7d8-4c24-bb2a-147c5af0e7af None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:21.326621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed10d4e-c7d8-4c24-bb2a-147c5af0e7af None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:21.326899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed10d4e-c7d8-4c24-bb2a-147c5af0e7af None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:21.327641 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed10d4e-c7d8-4c24-bb2a-147c5af0e7af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:21.327947 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed10d4e-c7d8-4c24-bb2a-147c5af0e7af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:21.329855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed10d4e-c7d8-4c24-bb2a-147c5af0e7af None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:21.337892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 532/1093] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:30:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:21.343574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed10d4e-c7d8-4c24-bb2a-147c5af0e7af None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:21.385704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:21.392577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4d42d-bc46-4d74-befe-e7617679cf35 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:21.426713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc35ad-f8a5-45c5-91d7-53e04e6d6b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:21.427372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc35ad-f8a5-45c5-91d7-53e04e6d6b75 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:21.427655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc35ad-f8a5-45c5-91d7-53e04e6d6b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:21.427933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc35ad-f8a5-45c5-91d7-53e04e6d6b75 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:21.428744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc35ad-f8a5-45c5-91d7-53e04e6d6b75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:21.429075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc35ad-f8a5-45c5-91d7-53e04e6d6b75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:21.430543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc35ad-f8a5-45c5-91d7-53e04e6d6b75 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:21.442321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 562/1094] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:30:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:21.443575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed10d4e-c7d8-4c24-bb2a-147c5af0e7af None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:21.448348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc35ad-f8a5-45c5-91d7-53e04e6d6b75 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:21.476288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5300655-5e6f-4407-b986-6d1ed76499fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:21.477161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300655-5e6f-4407-b986-6d1ed76499fc None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:21.477447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300655-5e6f-4407-b986-6d1ed76499fc None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:21.477721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5300655-5e6f-4407-b986-6d1ed76499fc None admin] PATH_INFO: `/v3/users/a1d453c02ad54b369da5dc4ca7af4169` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:21.478960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5300655-5e6f-4407-b986-6d1ed76499fc None admin] RBAC: Authorizing `identity:get_user(user_id=a1d453c02ad54b369da5dc4ca7af4169)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:21.480389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5300655-5e6f-4407-b986-6d1ed76499fc None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:21.487741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 533/1095] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:21 2022] GET /identity/v3/users/a1d453c02ad54b369da5dc4ca7af4169 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:21.488775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5300655-5e6f-4407-b986-6d1ed76499fc None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:21.504378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:21.554539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc35ad-f8a5-45c5-91d7-53e04e6d6b75 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:21.588037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5300655-5e6f-4407-b986-6d1ed76499fc None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:21.593778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527c1a-06ec-44dc-891b-6adcdb79fd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:21.593999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527c1a-06ec-44dc-891b-6adcdb79fd5c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:21.594317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527c1a-06ec-44dc-891b-6adcdb79fd5c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:21.594592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb527c1a-06ec-44dc-891b-6adcdb79fd5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:21.595424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527c1a-06ec-44dc-891b-6adcdb79fd5c None admin] RBAC: Adding query filter params (role.id=eb76f2b0416948d0b129dd08f0ddba37, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=eb66b6f6b5524f3687411fa83d525acc) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:21.595734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527c1a-06ec-44dc-891b-6adcdb79fd5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:21.597173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb527c1a-06ec-44dc-891b-6adcdb79fd5c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:21.603347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 563/1096] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:30:21 2022] GET /identity/v3/role_assignments?user.id=eb66b6f6b5524f3687411fa83d525acc&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=eb76f2b0416948d0b129dd08f0ddba37 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:21.625251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90191661-c3cf-456b-b0b8-a37d1a0ea108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:21.626682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90191661-c3cf-456b-b0b8-a37d1a0ea108 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:21.626960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90191661-c3cf-456b-b0b8-a37d1a0ea108 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:21.627232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90191661-c3cf-456b-b0b8-a37d1a0ea108 None admin] PATH_INFO: `/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:21.628475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90191661-c3cf-456b-b0b8-a37d1a0ea108 None admin] RBAC: Authorizing `identity:get_project(project_id=6a7ab7c02f674f0caa76e5d75f49547a)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:21.629939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90191661-c3cf-456b-b0b8-a37d1a0ea108 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:21.631806 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 534/1097] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:30:21 2022] GET /identity/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:21.638476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527c1a-06ec-44dc-891b-6adcdb79fd5c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:21.659098 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:21.744504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb527c1a-06ec-44dc-891b-6adcdb79fd5c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:21.779329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a0695-337c-401f-8024-a862480fe72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:21.780227 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a0695-337c-401f-8024-a862480fe72c None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:21.780509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a0695-337c-401f-8024-a862480fe72c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:21.780782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a0695-337c-401f-8024-a862480fe72c None admin] PATH_INFO: `/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a/users/a1d453c02ad54b369da5dc4ca7af4169/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:21.783963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a0695-337c-401f-8024-a862480fe72c None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7ab7c02f674f0caa76e5d75f49547a, user_id=a1d453c02ad54b369da5dc4ca7af4169, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:21.784772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a0695-337c-401f-8024-a862480fe72c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:21.799254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 564/1098] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:30:21 2022] PUT /identity/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a/users/a1d453c02ad54b369da5dc4ca7af4169/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:30:23.970401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a998d1-e9aa-4373-a351-e94b8623f1e7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:23.970941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a998d1-e9aa-4373-a351-e94b8623f1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:23.970941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a998d1-e9aa-4373-a351-e94b8623f1e7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:23.972333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 535/1099] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:23.977540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a6d7-4785-4772-bf71-de6a82b3f203 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:23.977976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a6d7-4785-4772-bf71-de6a82b3f203 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:23.978131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6a6d7-4785-4772-bf71-de6a82b3f203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:23.994562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bbc6a6d7-4785-4772-bf71-de6a82b3f203 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:23.995764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bbc6a6d7-4785-4772-bf71-de6a82b3f203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:24.060959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 565/1100] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:24.085102 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a998d1-e9aa-4373-a351-e94b8623f1e7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:24.164478 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:24.183822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a998d1-e9aa-4373-a351-e94b8623f1e7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:24.216375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8142132-0418-4684-aecd-ed0ec1b8a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:24.217156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142132-0418-4684-aecd-ed0ec1b8a98e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:24.217439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142132-0418-4684-aecd-ed0ec1b8a98e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:24.217715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8142132-0418-4684-aecd-ed0ec1b8a98e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:24.227890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8142132-0418-4684-aecd-ed0ec1b8a98e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-c8142132-0418-4684-aecd-ed0ec1b8a98e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:30:24.236030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:24.237185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:24.238452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 536/1101] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:30:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:24.243159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a6d7-4785-4772-bf71-de6a82b3f203 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:24.253663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:24.339523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6a6d7-4785-4772-bf71-de6a82b3f203 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:24.372459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd51f5-030a-47ca-8ea4-50e6b857dcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:24.373124 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd51f5-030a-47ca-8ea4-50e6b857dcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:24.373408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd51f5-030a-47ca-8ea4-50e6b857dcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:24.373684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd51f5-030a-47ca-8ea4-50e6b857dcc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:24.374461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd51f5-030a-47ca-8ea4-50e6b857dcc6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:24.374770 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd51f5-030a-47ca-8ea4-50e6b857dcc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:24.376723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd51f5-030a-47ca-8ea4-50e6b857dcc6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:24.384530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 566/1102] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:30:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:24.390651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8142132-0418-4684-aecd-ed0ec1b8a98e None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:24.487334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8142132-0418-4684-aecd-ed0ec1b8a98e None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:24.520138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151b1f9-25eb-4269-94c7-c5eb0d1c399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:24.520999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151b1f9-25eb-4269-94c7-c5eb0d1c399f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:24.521279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151b1f9-25eb-4269-94c7-c5eb0d1c399f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:24.521550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5151b1f9-25eb-4269-94c7-c5eb0d1c399f None admin] PATH_INFO: `/v3/users/a1d453c02ad54b369da5dc4ca7af4169` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:24.522712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151b1f9-25eb-4269-94c7-c5eb0d1c399f None admin] RBAC: Authorizing `identity:get_user(user_id=a1d453c02ad54b369da5dc4ca7af4169)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:24.524125 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5151b1f9-25eb-4269-94c7-c5eb0d1c399f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:24.525720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 537/1103] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:24 2022] GET /identity/v3/users/a1d453c02ad54b369da5dc4ca7af4169 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:24.532032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd51f5-030a-47ca-8ea4-50e6b857dcc6 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:24.599574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:24.632645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd51f5-030a-47ca-8ea4-50e6b857dcc6 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:24.664907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb10dc0-c3ca-4c91-a38d-4b3d47159c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:24.665539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb10dc0-c3ca-4c91-a38d-4b3d47159c8b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:24.665818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb10dc0-c3ca-4c91-a38d-4b3d47159c8b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:24.666101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb10dc0-c3ca-4c91-a38d-4b3d47159c8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:24.729912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb10dc0-c3ca-4c91-a38d-4b3d47159c8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:24.731376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb10dc0-c3ca-4c91-a38d-4b3d47159c8b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:24.795943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:24.826904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 567/1104] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:30:24.833450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151b1f9-25eb-4269-94c7-c5eb0d1c399f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:24.844061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:24.929764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5151b1f9-25eb-4269-94c7-c5eb0d1c399f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:24.962564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f9dda-2393-4e76-bbdd-a6ee47b6273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:24.963408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9dda-2393-4e76-bbdd-a6ee47b6273f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:24.963686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9dda-2393-4e76-bbdd-a6ee47b6273f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:24.963956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9dda-2393-4e76-bbdd-a6ee47b6273f None admin] PATH_INFO: `/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:24.965109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f9dda-2393-4e76-bbdd-a6ee47b6273f None admin] RBAC: Authorizing `identity:get_project(project_id=6a7ab7c02f674f0caa76e5d75f49547a)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:24.966555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f9dda-2393-4e76-bbdd-a6ee47b6273f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:24.968224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 538/1105] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:30:24 2022] GET /identity/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:24.974323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb10dc0-c3ca-4c91-a38d-4b3d47159c8b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:25.070707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb10dc0-c3ca-4c91-a38d-4b3d47159c8b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:25.104111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20446f47-0704-4a4c-bb34-35b783926aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:25.104754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20446f47-0704-4a4c-bb34-35b783926aac None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:25.105032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20446f47-0704-4a4c-bb34-35b783926aac None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:25.105304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20446f47-0704-4a4c-bb34-35b783926aac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:25.106162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20446f47-0704-4a4c-bb34-35b783926aac None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=6a7ab7c02f674f0caa76e5d75f49547a, user.id=a1d453c02ad54b369da5dc4ca7af4169) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:25.106469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20446f47-0704-4a4c-bb34-35b783926aac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:25.107895 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20446f47-0704-4a4c-bb34-35b783926aac None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:25.114289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 568/1106] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:30:24 2022] GET /identity/v3/role_assignments?user.id=a1d453c02ad54b369da5dc4ca7af4169&scope.project.id=6a7ab7c02f674f0caa76e5d75f49547a&role.id=308d9785120a49079e02659953a2b033 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:27.317018 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ed8b9-cc92-4381-bb9e-b2b24cae932f None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:27.317611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ed8b9-cc92-4381-bb9e-b2b24cae932f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:27.317611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ed8b9-cc92-4381-bb9e-b2b24cae932f None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:27.318977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 539/1107] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:27.324233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60a0a-d6c0-4896-8b7c-51fe1cab520d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:27.324655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60a0a-d6c0-4896-8b7c-51fe1cab520d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:27.324787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f60a0a-d6c0-4896-8b7c-51fe1cab520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:27.341052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-69f60a0a-d6c0-4896-8b7c-51fe1cab520d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:27.342262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-69f60a0a-d6c0-4896-8b7c-51fe1cab520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:27.368222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:27.407425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 569/1108] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:27.432289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ed8b9-cc92-4381-bb9e-b2b24cae932f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:27.507633 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:27.532108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ed8b9-cc92-4381-bb9e-b2b24cae932f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:27.564363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e7f968-f99f-4eca-8092-32edf5f35205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:27.565147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7f968-f99f-4eca-8092-32edf5f35205 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:27.565432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7f968-f99f-4eca-8092-32edf5f35205 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:27.565712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e7f968-f99f-4eca-8092-32edf5f35205 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:27.566918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7f968-f99f-4eca-8092-32edf5f35205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:27.568387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e7f968-f99f-4eca-8092-32edf5f35205 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:27.569952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 540/1109] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:27.575778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60a0a-d6c0-4896-8b7c-51fe1cab520d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:27.677479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f60a0a-d6c0-4896-8b7c-51fe1cab520d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:27.710520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef00bdf-d6dc-49e4-ac92-b39b53835297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:27.711186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef00bdf-d6dc-49e4-ac92-b39b53835297 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:27.711469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef00bdf-d6dc-49e4-ac92-b39b53835297 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:27.711742 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef00bdf-d6dc-49e4-ac92-b39b53835297 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:27.712437 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef00bdf-d6dc-49e4-ac92-b39b53835297 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:27.713874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef00bdf-d6dc-49e4-ac92-b39b53835297 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:27.732646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 570/1110] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:30:27 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:30:29.959097 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648e9e-a2ce-4ec0-aaee-2a31ba02c63a None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:29.959619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648e9e-a2ce-4ec0-aaee-2a31ba02c63a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:29.959717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca648e9e-a2ce-4ec0-aaee-2a31ba02c63a None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:29.961053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 541/1111] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:29.966492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdd6e-bdb1-463a-8e9f-23201b49be48 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:29.966932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdd6e-bdb1-463a-8e9f-23201b49be48 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:29.967028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fdd6e-bdb1-463a-8e9f-23201b49be48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:29.984424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-419fdd6e-bdb1-463a-8e9f-23201b49be48 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:29.985598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-419fdd6e-bdb1-463a-8e9f-23201b49be48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:30.000580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:30.055971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 571/1112] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:30:30.079415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca648e9e-a2ce-4ec0-aaee-2a31ba02c63a None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:30.182236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca648e9e-a2ce-4ec0-aaee-2a31ba02c63a None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:30.215318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2ee37-be8a-4eb2-bf33-36a8ac8095ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:30.216484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2ee37-be8a-4eb2-bf33-36a8ac8095ba None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:30.216760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2ee37-be8a-4eb2-bf33-36a8ac8095ba None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:30.217031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2ee37-be8a-4eb2-bf33-36a8ac8095ba None admin] PATH_INFO: `/v3/roles/5cb95ca9624d408a80d77ecc45d0c310` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:30.219046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2ee37-be8a-4eb2-bf33-36a8ac8095ba None admin] RBAC: Authorizing `identity:get_role(role_id=5cb95ca9624d408a80d77ecc45d0c310)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:30.220395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2ee37-be8a-4eb2-bf33-36a8ac8095ba None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:30.221764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 542/1113] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:30 2022] GET /identity/v3/roles/5cb95ca9624d408a80d77ecc45d0c310 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:30.227604 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fdd6e-bdb1-463a-8e9f-23201b49be48 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:30.329855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fdd6e-bdb1-463a-8e9f-23201b49be48 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:30.364433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb3b8e-dbc1-43d5-83fe-185a386c8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:30.365301 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb3b8e-dbc1-43d5-83fe-185a386c8efe None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:30.365581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb3b8e-dbc1-43d5-83fe-185a386c8efe None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:30.365860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb3b8e-dbc1-43d5-83fe-185a386c8efe None admin] PATH_INFO: `/v3/users/f215dcd7944e47da9780bc3e56933138` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:30.379037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb3b8e-dbc1-43d5-83fe-185a386c8efe None admin] RBAC: Authorizing `identity:get_user(user_id=f215dcd7944e47da9780bc3e56933138)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:30.380493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb3b8e-dbc1-43d5-83fe-185a386c8efe None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:30.382182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 572/1114] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:30 2022] GET /identity/v3/users/f215dcd7944e47da9780bc3e56933138 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:30.388338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2ee37-be8a-4eb2-bf33-36a8ac8095ba None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:30.403913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:30.489607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2ee37-be8a-4eb2-bf33-36a8ac8095ba None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:30.523866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bd36b-6c8c-4183-ab1d-f9e24cbad466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:30.524506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bd36b-6c8c-4183-ab1d-f9e24cbad466 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:30.524787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bd36b-6c8c-4183-ab1d-f9e24cbad466 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:30.525065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88bd36b-6c8c-4183-ab1d-f9e24cbad466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:30.592414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bd36b-6c8c-4183-ab1d-f9e24cbad466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:30.594432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88bd36b-6c8c-4183-ab1d-f9e24cbad466 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:30.608751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:30.695449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 543/1115] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:30:30.701364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb3b8e-dbc1-43d5-83fe-185a386c8efe None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:30.713088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:30.803914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb3b8e-dbc1-43d5-83fe-185a386c8efe None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:30.837923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa053a-6489-4b30-89a0-9d16b7b7c4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:30.838809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa053a-6489-4b30-89a0-9d16b7b7c4bb None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:30.839092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa053a-6489-4b30-89a0-9d16b7b7c4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:30.839367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa053a-6489-4b30-89a0-9d16b7b7c4bb None admin] PATH_INFO: `/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:30.840569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa053a-6489-4b30-89a0-9d16b7b7c4bb None admin] RBAC: Authorizing `identity:get_project(project_id=6a7ab7c02f674f0caa76e5d75f49547a)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:30.842010 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa053a-6489-4b30-89a0-9d16b7b7c4bb None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:30.848655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 573/1116] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:30:30 2022] GET /identity/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:30.849873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bd36b-6c8c-4183-ab1d-f9e24cbad466 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:30.950654 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88bd36b-6c8c-4183-ab1d-f9e24cbad466 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:30.964541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:30.986957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3bb28-b082-44fd-8a31-a489b9ed5b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:30.987634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3bb28-b082-44fd-8a31-a489b9ed5b74 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:30.987913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3bb28-b082-44fd-8a31-a489b9ed5b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:30.988185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3bb28-b082-44fd-8a31-a489b9ed5b74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:30.989002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3bb28-b082-44fd-8a31-a489b9ed5b74 None admin] RBAC: Adding query filter params (role.id=5cb95ca9624d408a80d77ecc45d0c310, scope.project.id=6a7ab7c02f674f0caa76e5d75f49547a, user.id=f215dcd7944e47da9780bc3e56933138) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:30.989310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3bb28-b082-44fd-8a31-a489b9ed5b74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:30.990761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3bb28-b082-44fd-8a31-a489b9ed5b74 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:30.996209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 544/1117] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:30:30 2022] GET /identity/v3/role_assignments?user.id=f215dcd7944e47da9780bc3e56933138&scope.project.id=6a7ab7c02f674f0caa76e5d75f49547a&role.id=5cb95ca9624d408a80d77ecc45d0c310 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:33.161775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18de8e0-6352-45d4-8708-fad4657a4f1e None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:33.162405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18de8e0-6352-45d4-8708-fad4657a4f1e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:33.162405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18de8e0-6352-45d4-8708-fad4657a4f1e None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:33.163725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 574/1118] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:33.168976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b265cb-a23f-4e51-b1e2-5c2d118a1927 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:33.169419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b265cb-a23f-4e51-b1e2-5c2d118a1927 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:33.169544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b265cb-a23f-4e51-b1e2-5c2d118a1927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:33.187420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-57b265cb-a23f-4e51-b1e2-5c2d118a1927 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:33.188605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-57b265cb-a23f-4e51-b1e2-5c2d118a1927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:33.255437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 545/1119] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:33.278577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18de8e0-6352-45d4-8708-fad4657a4f1e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:33.358218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:33.382425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18de8e0-6352-45d4-8708-fad4657a4f1e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:33.418443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8875-4482-4603-89fe-959737b3e5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:33.419244 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8875-4482-4603-89fe-959737b3e5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:33.419526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8875-4482-4603-89fe-959737b3e5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:33.419800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6b8875-4482-4603-89fe-959737b3e5a1 None admin] PATH_INFO: `/v3/roles/5cb95ca9624d408a80d77ecc45d0c310` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:33.421275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b8875-4482-4603-89fe-959737b3e5a1 None admin] RBAC: Authorizing `identity:get_role(role_id=5cb95ca9624d408a80d77ecc45d0c310)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:33.423210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6b8875-4482-4603-89fe-959737b3e5a1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:33.424575 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 575/1120] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:33 2022] GET /identity/v3/roles/5cb95ca9624d408a80d77ecc45d0c310 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:33.430532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b265cb-a23f-4e51-b1e2-5c2d118a1927 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:33.532077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b265cb-a23f-4e51-b1e2-5c2d118a1927 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:33.539551 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:33.567532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e997175-213b-4311-9dd8-3733445a0c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:33.568409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e997175-213b-4311-9dd8-3733445a0c2e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:33.568694 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e997175-213b-4311-9dd8-3733445a0c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:33.568979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e997175-213b-4311-9dd8-3733445a0c2e None admin] PATH_INFO: `/v3/users/f215dcd7944e47da9780bc3e56933138` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:33.570202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e997175-213b-4311-9dd8-3733445a0c2e None admin] RBAC: Authorizing `identity:get_user(user_id=f215dcd7944e47da9780bc3e56933138)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:33.571639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e997175-213b-4311-9dd8-3733445a0c2e None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:33.573281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 546/1121] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:33 2022] GET /identity/v3/users/f215dcd7944e47da9780bc3e56933138 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:33.579154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8875-4482-4603-89fe-959737b3e5a1 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:33.685581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6b8875-4482-4603-89fe-959737b3e5a1 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:33.721145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbe22b-6064-4149-919b-f27afa8e12a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:33.722011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe22b-6064-4149-919b-f27afa8e12a6 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:33.722326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe22b-6064-4149-919b-f27afa8e12a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:33.722607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbe22b-6064-4149-919b-f27afa8e12a6 None admin] PATH_INFO: `/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:33.723789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbe22b-6064-4149-919b-f27afa8e12a6 None admin] RBAC: Authorizing `identity:get_project(project_id=6a7ab7c02f674f0caa76e5d75f49547a)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:33.725225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbbe22b-6064-4149-919b-f27afa8e12a6 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:33.726958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 576/1122] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:30:33 2022] GET /identity/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:33.732809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e997175-213b-4311-9dd8-3733445a0c2e None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:33.829462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e997175-213b-4311-9dd8-3733445a0c2e None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:33.868073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d7946-ac30-4e63-bd80-3eed0702f49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:33.869035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7946-ac30-4e63-bd80-3eed0702f49c None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:33.869312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7946-ac30-4e63-bd80-3eed0702f49c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:33.869586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d7946-ac30-4e63-bd80-3eed0702f49c None admin] PATH_INFO: `/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a/users/f215dcd7944e47da9780bc3e56933138/roles/5cb95ca9624d408a80d77ecc45d0c310` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:33.871824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d7946-ac30-4e63-bd80-3eed0702f49c None admin] RBAC: Authorizing `identity:create_grant(project_id=6a7ab7c02f674f0caa76e5d75f49547a, user_id=f215dcd7944e47da9780bc3e56933138, role_id=5cb95ca9624d408a80d77ecc45d0c310)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:33.873242 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d7946-ac30-4e63-bd80-3eed0702f49c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:33.886815 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 547/1123] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:30:33 2022] PUT /identity/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a/users/f215dcd7944e47da9780bc3e56933138/roles/5cb95ca9624d408a80d77ecc45d0c310 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:30:36.060388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c9847-54f4-48ca-a7c2-14387923ecb1 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:36.060900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c9847-54f4-48ca-a7c2-14387923ecb1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:36.060988 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c9847-54f4-48ca-a7c2-14387923ecb1 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:36.062333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 577/1124] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:36.067465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335c4ca-2f3d-43d7-a84b-9a6ee097d78e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:36.067897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335c4ca-2f3d-43d7-a84b-9a6ee097d78e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:36.068015 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335c4ca-2f3d-43d7-a84b-9a6ee097d78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:36.084542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-b335c4ca-2f3d-43d7-a84b-9a6ee097d78e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:36.085732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b335c4ca-2f3d-43d7-a84b-9a6ee097d78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:36.115084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:36.156885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 548/1125] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:36.181205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c9847-54f4-48ca-a7c2-14387923ecb1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:36.196161 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:36.283738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c9847-54f4-48ca-a7c2-14387923ecb1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:36.317500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068bbab-18cd-4712-9db5-4bba8d9b7732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:36.318404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068bbab-18cd-4712-9db5-4bba8d9b7732 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:36.318686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068bbab-18cd-4712-9db5-4bba8d9b7732 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:36.318956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068bbab-18cd-4712-9db5-4bba8d9b7732 None admin] PATH_INFO: `/v3/roles/5cb95ca9624d408a80d77ecc45d0c310` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:36.320467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068bbab-18cd-4712-9db5-4bba8d9b7732 None admin] RBAC: Authorizing `identity:get_role(role_id=5cb95ca9624d408a80d77ecc45d0c310)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:36.321847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068bbab-18cd-4712-9db5-4bba8d9b7732 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:36.323245 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 578/1126] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:36 2022] GET /identity/v3/roles/5cb95ca9624d408a80d77ecc45d0c310 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:36.329525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335c4ca-2f3d-43d7-a84b-9a6ee097d78e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:36.425316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b335c4ca-2f3d-43d7-a84b-9a6ee097d78e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:36.458423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b139-6eed-44ce-8759-440856d4f371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:36.459277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b139-6eed-44ce-8759-440856d4f371 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:36.459554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b139-6eed-44ce-8759-440856d4f371 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:36.459822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4b139-6eed-44ce-8759-440856d4f371 None admin] PATH_INFO: `/v3/users/f215dcd7944e47da9780bc3e56933138` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:36.460989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4b139-6eed-44ce-8759-440856d4f371 None admin] RBAC: Authorizing `identity:get_user(user_id=f215dcd7944e47da9780bc3e56933138)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:36.462449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4b139-6eed-44ce-8759-440856d4f371 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:36.464058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 549/1127] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:36 2022] GET /identity/v3/users/f215dcd7944e47da9780bc3e56933138 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:36.470464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068bbab-18cd-4712-9db5-4bba8d9b7732 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:36.547725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:36.566675 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068bbab-18cd-4712-9db5-4bba8d9b7732 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:36.600416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da974bb4-4326-4d27-ba6b-a1fb3fb593c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:36.601053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974bb4-4326-4d27-ba6b-a1fb3fb593c2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:36.601336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974bb4-4326-4d27-ba6b-a1fb3fb593c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:36.601612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da974bb4-4326-4d27-ba6b-a1fb3fb593c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:36.666190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da974bb4-4326-4d27-ba6b-a1fb3fb593c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:36.667629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da974bb4-4326-4d27-ba6b-a1fb3fb593c2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:36.743118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:36.762921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 579/1128] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:30:36.769376 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b139-6eed-44ce-8759-440856d4f371 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:36.799188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:36.865123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4b139-6eed-44ce-8759-440856d4f371 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:36.898531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46636078-7353-4b9c-8c0d-664c973152f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:36.899386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636078-7353-4b9c-8c0d-664c973152f1 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:36.899666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636078-7353-4b9c-8c0d-664c973152f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:36.899939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46636078-7353-4b9c-8c0d-664c973152f1 None admin] PATH_INFO: `/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:36.901103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46636078-7353-4b9c-8c0d-664c973152f1 None admin] RBAC: Authorizing `identity:get_project(project_id=6a7ab7c02f674f0caa76e5d75f49547a)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:36.902562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46636078-7353-4b9c-8c0d-664c973152f1 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:36.904249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 550/1129] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:30:36 2022] GET /identity/v3/projects/6a7ab7c02f674f0caa76e5d75f49547a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:36.910247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da974bb4-4326-4d27-ba6b-a1fb3fb593c2 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:37.006269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da974bb4-4326-4d27-ba6b-a1fb3fb593c2 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:37.038376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe7ddd-f13a-434e-b62b-e51968034843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:37.039008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe7ddd-f13a-434e-b62b-e51968034843 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:37.039290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe7ddd-f13a-434e-b62b-e51968034843 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:37.039561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe7ddd-f13a-434e-b62b-e51968034843 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:37.040377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe7ddd-f13a-434e-b62b-e51968034843 None admin] RBAC: Adding query filter params (role.id=5cb95ca9624d408a80d77ecc45d0c310, scope.project.id=6a7ab7c02f674f0caa76e5d75f49547a, user.id=f215dcd7944e47da9780bc3e56933138) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:37.040684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe7ddd-f13a-434e-b62b-e51968034843 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:37.042108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfe7ddd-f13a-434e-b62b-e51968034843 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:37.048231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 580/1130] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:30:36 2022] GET /identity/v3/role_assignments?user.id=f215dcd7944e47da9780bc3e56933138&scope.project.id=6a7ab7c02f674f0caa76e5d75f49547a&role.id=5cb95ca9624d408a80d77ecc45d0c310 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:39.238682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0935c81-256c-46bf-b872-bce7252b4433 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:39.239218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0935c81-256c-46bf-b872-bce7252b4433 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:39.239218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0935c81-256c-46bf-b872-bce7252b4433 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:39.240602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 551/1131] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:39.245921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd26f3-ad32-444b-b348-269528fbc364 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:39.246373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd26f3-ad32-444b-b348-269528fbc364 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:39.246514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dd26f3-ad32-444b-b348-269528fbc364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:39.263171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a9dd26f3-ad32-444b-b348-269528fbc364 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:39.264346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a9dd26f3-ad32-444b-b348-269528fbc364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:39.303530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:39.330451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 581/1132] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:39.354021 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0935c81-256c-46bf-b872-bce7252b4433 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:39.448618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:39.452860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0935c81-256c-46bf-b872-bce7252b4433 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:39.486367 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84602fde-42f0-4e98-a9dc-ce5dd9afeeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:39.487144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602fde-42f0-4e98-a9dc-ce5dd9afeeaf None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:39.487428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602fde-42f0-4e98-a9dc-ce5dd9afeeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:39.487705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602fde-42f0-4e98-a9dc-ce5dd9afeeaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:39.488924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84602fde-42f0-4e98-a9dc-ce5dd9afeeaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:39.490332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84602fde-42f0-4e98-a9dc-ce5dd9afeeaf None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:39.491918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 552/1133] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:39.497550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd26f3-ad32-444b-b348-269528fbc364 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:39.591278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dd26f3-ad32-444b-b348-269528fbc364 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:39.624183 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf281515-0983-42b0-9af0-afd4a3254e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:39.624851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf281515-0983-42b0-9af0-afd4a3254e41 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:39.625128 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf281515-0983-42b0-9af0-afd4a3254e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:39.625398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf281515-0983-42b0-9af0-afd4a3254e41 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:39.626125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf281515-0983-42b0-9af0-afd4a3254e41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:39.627546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf281515-0983-42b0-9af0-afd4a3254e41 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:39.651081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 582/1134] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:30:39 2022] POST /identity/v3/projects => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:30:41.879556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296ff4c-7869-4ecc-8f15-ade62f4cb875 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:41.879957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296ff4c-7869-4ecc-8f15-ade62f4cb875 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:41.880107 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7296ff4c-7869-4ecc-8f15-ade62f4cb875 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:41.881471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 553/1135] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:41.887078 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a927-cd0e-4f55-a9a9-bcb102b37abb None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:41.887453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a927-cd0e-4f55-a9a9-bcb102b37abb None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:41.887640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a927-cd0e-4f55-a9a9-bcb102b37abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:41.904588 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-74e7a927-cd0e-4f55-a9a9-bcb102b37abb None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:41.905754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-74e7a927-cd0e-4f55-a9a9-bcb102b37abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:41.925080 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:41.971024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 583/1136] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:41.994836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296ff4c-7869-4ecc-8f15-ade62f4cb875 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:42.093090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7296ff4c-7869-4ecc-8f15-ade62f4cb875 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:42.126428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966a00c-4776-41d9-a24f-0082a0d26f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:42.127147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a00c-4776-41d9-a24f-0082a0d26f55 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:42.127429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a00c-4776-41d9-a24f-0082a0d26f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:42.127703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966a00c-4776-41d9-a24f-0082a0d26f55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:42.128869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a00c-4776-41d9-a24f-0082a0d26f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:42.130312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966a00c-4776-41d9-a24f-0082a0d26f55 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:42.131879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 554/1137] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:30:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:42.137604 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7a927-cd0e-4f55-a9a9-bcb102b37abb None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:42.232337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7a927-cd0e-4f55-a9a9-bcb102b37abb None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:42.265314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5930c-3005-4d98-b780-a2dcfe73b600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:42.265956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5930c-3005-4d98-b780-a2dcfe73b600 None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:42.266268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5930c-3005-4d98-b780-a2dcfe73b600 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:42.266541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5930c-3005-4d98-b780-a2dcfe73b600 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:42.267233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5930c-3005-4d98-b780-a2dcfe73b600 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:42.268659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5930c-3005-4d98-b780-a2dcfe73b600 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:42.287567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 584/1138] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:30:42 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:30:44.491820 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac789fe-e9fd-4e88-93c7-28790a70db8f None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:44.492372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac789fe-e9fd-4e88-93c7-28790a70db8f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:44.492372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac789fe-e9fd-4e88-93c7-28790a70db8f None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:44.493743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 555/1139] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:44.498865 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bf16-8c4e-40f1-a21a-3a1b516c5b74 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:44.499230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bf16-8c4e-40f1-a21a-3a1b516c5b74 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:44.499470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b52bf16-8c4e-40f1-a21a-3a1b516c5b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:44.516517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5b52bf16-8c4e-40f1-a21a-3a1b516c5b74 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:44.517683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5b52bf16-8c4e-40f1-a21a-3a1b516c5b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:44.524755 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:44.582861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 585/1140] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:44.605340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac789fe-e9fd-4e88-93c7-28790a70db8f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:44.641371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:44.704475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac789fe-e9fd-4e88-93c7-28790a70db8f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:44.737644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040a76a-93e8-4435-9114-d359bb18e8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:44.738452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a76a-93e8-4435-9114-d359bb18e8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:44.738737 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a76a-93e8-4435-9114-d359bb18e8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:44.739012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040a76a-93e8-4435-9114-d359bb18e8a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:44.748859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040a76a-93e8-4435-9114-d359bb18e8a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-a040a76a-93e8-4435-9114-d359bb18e8a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:30:44.756542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:44.757652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:44.758724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 556/1141] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:30:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:44.764246 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bf16-8c4e-40f1-a21a-3a1b516c5b74 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:44.860212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b52bf16-8c4e-40f1-a21a-3a1b516c5b74 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:44.892838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd440f6c-7e4b-4ba9-ba2e-3fcc4a62e220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:44.893498 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440f6c-7e4b-4ba9-ba2e-3fcc4a62e220 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:44.893781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440f6c-7e4b-4ba9-ba2e-3fcc4a62e220 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:44.894059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd440f6c-7e4b-4ba9-ba2e-3fcc4a62e220 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:44.894839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440f6c-7e4b-4ba9-ba2e-3fcc4a62e220 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:44.895146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440f6c-7e4b-4ba9-ba2e-3fcc4a62e220 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:44.896518 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd440f6c-7e4b-4ba9-ba2e-3fcc4a62e220 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:44.904338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 586/1142] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:30:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:44.910530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040a76a-93e8-4435-9114-d359bb18e8a2 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:45.002440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:45.008312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040a76a-93e8-4435-9114-d359bb18e8a2 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:45.041419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557d428-c9b5-4a02-ba7d-1ddc331db2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:45.042305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557d428-c9b5-4a02-ba7d-1ddc331db2ef None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:45.042592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557d428-c9b5-4a02-ba7d-1ddc331db2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:45.042869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e557d428-c9b5-4a02-ba7d-1ddc331db2ef None admin] PATH_INFO: `/v3/users/d854308aab05463d9641114b751f890d` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:45.055624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557d428-c9b5-4a02-ba7d-1ddc331db2ef None admin] RBAC: Authorizing `identity:get_user(user_id=d854308aab05463d9641114b751f890d)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:45.057051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e557d428-c9b5-4a02-ba7d-1ddc331db2ef None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:45.058702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 557/1143] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:44 2022] GET /identity/v3/users/d854308aab05463d9641114b751f890d => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:45.064307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd440f6c-7e4b-4ba9-ba2e-3fcc4a62e220 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:45.068008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:45.161703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd440f6c-7e4b-4ba9-ba2e-3fcc4a62e220 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:45.193273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a65215-b4bc-43b4-b1f9-a10190296064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:45.193908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a65215-b4bc-43b4-b1f9-a10190296064 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:45.194218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a65215-b4bc-43b4-b1f9-a10190296064 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:45.194499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a65215-b4bc-43b4-b1f9-a10190296064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:45.259163 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a65215-b4bc-43b4-b1f9-a10190296064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:45.260801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a65215-b4bc-43b4-b1f9-a10190296064 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:45.263347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:45.354716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 587/1144] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:30:45.361033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557d428-c9b5-4a02-ba7d-1ddc331db2ef None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:45.458107 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e557d428-c9b5-4a02-ba7d-1ddc331db2ef None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:45.489896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fcda1-60a9-411c-8f34-adf626e6e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:45.490764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fcda1-60a9-411c-8f34-adf626e6e7eb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:45.491038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fcda1-60a9-411c-8f34-adf626e6e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:45.491303 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fcda1-60a9-411c-8f34-adf626e6e7eb None admin] PATH_INFO: `/v3/projects/095d08efabf8413985ea367011583248` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:45.492451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fcda1-60a9-411c-8f34-adf626e6e7eb None admin] RBAC: Authorizing `identity:get_project(project_id=095d08efabf8413985ea367011583248)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:45.493856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5fcda1-60a9-411c-8f34-adf626e6e7eb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:45.495534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 558/1145] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:30:45 2022] GET /identity/v3/projects/095d08efabf8413985ea367011583248 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:45.501847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a65215-b4bc-43b4-b1f9-a10190296064 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:45.598422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a65215-b4bc-43b4-b1f9-a10190296064 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:45.600608 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:45.632438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881645b5-e501-4fb1-bd29-2f5e43675335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:45.633077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881645b5-e501-4fb1-bd29-2f5e43675335 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:45.633362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881645b5-e501-4fb1-bd29-2f5e43675335 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:45.633640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881645b5-e501-4fb1-bd29-2f5e43675335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:45.634494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881645b5-e501-4fb1-bd29-2f5e43675335 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=095d08efabf8413985ea367011583248, user.id=d854308aab05463d9641114b751f890d) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:45.635054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881645b5-e501-4fb1-bd29-2f5e43675335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:45.636492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881645b5-e501-4fb1-bd29-2f5e43675335 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:45.642419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 588/1146] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:30:45 2022] GET /identity/v3/role_assignments?user.id=d854308aab05463d9641114b751f890d&scope.project.id=095d08efabf8413985ea367011583248&role.id=308d9785120a49079e02659953a2b033 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:47.758769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc394b1-42cc-4bea-bb17-ce587e3fd20c None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:47.759299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc394b1-42cc-4bea-bb17-ce587e3fd20c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:47.759299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc394b1-42cc-4bea-bb17-ce587e3fd20c None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:47.760933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 559/1147] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:47.766776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b76da-36fe-42b8-b54e-602b95e45984 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:47.767154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b76da-36fe-42b8-b54e-602b95e45984 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:47.767329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b76da-36fe-42b8-b54e-602b95e45984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:47.785290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e38b76da-36fe-42b8-b54e-602b95e45984 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:47.786501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e38b76da-36fe-42b8-b54e-602b95e45984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:47.854919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 589/1148] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:47.877533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc394b1-42cc-4bea-bb17-ce587e3fd20c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:47.903037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:47.980760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc394b1-42cc-4bea-bb17-ce587e3fd20c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:48.014386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007c69f-d0ca-4221-84b9-b19eabeceda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:48.015659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007c69f-d0ca-4221-84b9-b19eabeceda2 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:48.015938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007c69f-d0ca-4221-84b9-b19eabeceda2 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:48.016210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007c69f-d0ca-4221-84b9-b19eabeceda2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:48.025998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007c69f-d0ca-4221-84b9-b19eabeceda2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-6007c69f-d0ca-4221-84b9-b19eabeceda2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:30:48.033727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:48.034850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:48.035905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 560/1149] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:30:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:48.041003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b76da-36fe-42b8-b54e-602b95e45984 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:48.133450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:48.137629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b76da-36fe-42b8-b54e-602b95e45984 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:48.170667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5ef4e-4a98-4d23-bc82-2a58b0cb7b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:48.171822 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5ef4e-4a98-4d23-bc82-2a58b0cb7b87 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:48.172104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5ef4e-4a98-4d23-bc82-2a58b0cb7b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:48.172377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5ef4e-4a98-4d23-bc82-2a58b0cb7b87 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:48.173114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5ef4e-4a98-4d23-bc82-2a58b0cb7b87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:48.173419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5ef4e-4a98-4d23-bc82-2a58b0cb7b87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:48.174824 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5ef4e-4a98-4d23-bc82-2a58b0cb7b87 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:48.182732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 590/1150] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:30:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:48.189275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007c69f-d0ca-4221-84b9-b19eabeceda2 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:48.268325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:48.285511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007c69f-d0ca-4221-84b9-b19eabeceda2 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:48.318665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce87a7-36d5-433e-aeee-97f769d5bdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:48.319540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce87a7-36d5-433e-aeee-97f769d5bdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:48.319828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce87a7-36d5-433e-aeee-97f769d5bdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:48.320104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce87a7-36d5-433e-aeee-97f769d5bdb2 None admin] PATH_INFO: `/v3/users/d854308aab05463d9641114b751f890d` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:48.321292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce87a7-36d5-433e-aeee-97f769d5bdb2 None admin] RBAC: Authorizing `identity:get_user(user_id=d854308aab05463d9641114b751f890d)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:48.322767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce87a7-36d5-433e-aeee-97f769d5bdb2 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:48.324406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 561/1151] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:48 2022] GET /identity/v3/users/d854308aab05463d9641114b751f890d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:48.330161 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5ef4e-4a98-4d23-bc82-2a58b0cb7b87 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:48.427043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5ef4e-4a98-4d23-bc82-2a58b0cb7b87 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:48.460296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2b282-e90c-4839-885b-774d54ec89ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:48.461152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2b282-e90c-4839-885b-774d54ec89ac None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:48.461435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2b282-e90c-4839-885b-774d54ec89ac None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:48.461710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2b282-e90c-4839-885b-774d54ec89ac None admin] PATH_INFO: `/v3/projects/095d08efabf8413985ea367011583248` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:48.462903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2b282-e90c-4839-885b-774d54ec89ac None admin] RBAC: Authorizing `identity:get_project(project_id=095d08efabf8413985ea367011583248)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:48.464483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2b282-e90c-4839-885b-774d54ec89ac None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:48.466191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 591/1152] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:30:48 2022] GET /identity/v3/projects/095d08efabf8413985ea367011583248 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:48.472058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce87a7-36d5-433e-aeee-97f769d5bdb2 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:48.570837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce87a7-36d5-433e-aeee-97f769d5bdb2 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:48.603124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a375710-81cc-4ba1-aff1-4309dc61f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:48.604005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a375710-81cc-4ba1-aff1-4309dc61f38a None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:48.604287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a375710-81cc-4ba1-aff1-4309dc61f38a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:48.604563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a375710-81cc-4ba1-aff1-4309dc61f38a None admin] PATH_INFO: `/v3/projects/095d08efabf8413985ea367011583248/users/d854308aab05463d9641114b751f890d/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:48.606535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a375710-81cc-4ba1-aff1-4309dc61f38a None admin] RBAC: Authorizing `identity:create_grant(project_id=095d08efabf8413985ea367011583248, user_id=d854308aab05463d9641114b751f890d, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:48.607996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a375710-81cc-4ba1-aff1-4309dc61f38a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:48.620659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 562/1153] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:30:48 2022] PUT /identity/v3/projects/095d08efabf8413985ea367011583248/users/d854308aab05463d9641114b751f890d/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:30:50.766209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e8be-66bd-48e4-9708-370950820b7f None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:50.766768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e8be-66bd-48e4-9708-370950820b7f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:50.766768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5e8be-66bd-48e4-9708-370950820b7f None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:50.768117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 592/1154] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:50.773236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60380443-7306-4124-b20a-ff180d7800ce None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:50.773648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60380443-7306-4124-b20a-ff180d7800ce None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:50.773793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60380443-7306-4124-b20a-ff180d7800ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:50.790710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-60380443-7306-4124-b20a-ff180d7800ce None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:50.791891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-60380443-7306-4124-b20a-ff180d7800ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:50.794693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:50.859876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 563/1155] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:50.882590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5e8be-66bd-48e4-9708-370950820b7f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:50.910904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:50.981807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5e8be-66bd-48e4-9708-370950820b7f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:51.014522 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb27662-3b6b-4d52-9c4e-185b495cded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:51.015868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb27662-3b6b-4d52-9c4e-185b495cded0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:51.016151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb27662-3b6b-4d52-9c4e-185b495cded0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:51.016473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb27662-3b6b-4d52-9c4e-185b495cded0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:51.026153 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb27662-3b6b-4d52-9c4e-185b495cded0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-4bb27662-3b6b-4d52-9c4e-185b495cded0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:30:51.033907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:51.035027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:30:51.036030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 593/1156] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:30:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:51.040937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60380443-7306-4124-b20a-ff180d7800ce None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:51.136757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60380443-7306-4124-b20a-ff180d7800ce None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:51.168878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7fdc9-0739-48ae-898c-5ae2be6999e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:51.169529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7fdc9-0739-48ae-898c-5ae2be6999e9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:51.169809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7fdc9-0739-48ae-898c-5ae2be6999e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:51.170110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7fdc9-0739-48ae-898c-5ae2be6999e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:51.171369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7fdc9-0739-48ae-898c-5ae2be6999e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:51.171679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7fdc9-0739-48ae-898c-5ae2be6999e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:51.173054 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7fdc9-0739-48ae-898c-5ae2be6999e9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:51.180860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 564/1157] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:30:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:51.187069 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb27662-3b6b-4d52-9c4e-185b495cded0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:51.271571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:51.283713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb27662-3b6b-4d52-9c4e-185b495cded0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:51.316342 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b530-89f4-4300-b5a4-87e768a19778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:51.317198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b530-89f4-4300-b5a4-87e768a19778 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:51.317484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b530-89f4-4300-b5a4-87e768a19778 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:51.318132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee31b530-89f4-4300-b5a4-87e768a19778 None admin] PATH_INFO: `/v3/users/d854308aab05463d9641114b751f890d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:51.319283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31b530-89f4-4300-b5a4-87e768a19778 None admin] RBAC: Authorizing `identity:get_user(user_id=d854308aab05463d9641114b751f890d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:51.320711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee31b530-89f4-4300-b5a4-87e768a19778 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:51.322404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 594/1158] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:30:51 2022] GET /identity/v3/users/d854308aab05463d9641114b751f890d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:51.327968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7fdc9-0739-48ae-898c-5ae2be6999e9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:51.330822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:51.427356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7fdc9-0739-48ae-898c-5ae2be6999e9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:51.459544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b46379-7a63-4537-8be4-4d8d6247cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:51.460177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b46379-7a63-4537-8be4-4d8d6247cbfc None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:51.460460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b46379-7a63-4537-8be4-4d8d6247cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:51.460736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b46379-7a63-4537-8be4-4d8d6247cbfc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:51.526007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b46379-7a63-4537-8be4-4d8d6247cbfc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:51.527416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b46379-7a63-4537-8be4-4d8d6247cbfc None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:51.529147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:51.623571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 565/1159] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:30:51.629384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b530-89f4-4300-b5a4-87e768a19778 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:51.724973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee31b530-89f4-4300-b5a4-87e768a19778 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:51.756622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739b8ef-d7ec-4351-b6f7-6feb76407657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:51.757457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b8ef-d7ec-4351-b6f7-6feb76407657 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:51.757734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b8ef-d7ec-4351-b6f7-6feb76407657 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:51.758005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b8ef-d7ec-4351-b6f7-6feb76407657 None admin] PATH_INFO: `/v3/projects/095d08efabf8413985ea367011583248` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:51.759175 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739b8ef-d7ec-4351-b6f7-6feb76407657 None admin] RBAC: Authorizing `identity:get_project(project_id=095d08efabf8413985ea367011583248)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:51.760846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739b8ef-d7ec-4351-b6f7-6feb76407657 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:51.762508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 595/1160] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:30:51 2022] GET /identity/v3/projects/095d08efabf8413985ea367011583248 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:51.768728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b46379-7a63-4537-8be4-4d8d6247cbfc None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:51.864015 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b46379-7a63-4537-8be4-4d8d6247cbfc None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:51.865524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:51.904397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9816f-63b8-4253-8fd1-2927af9f849f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:51.905042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9816f-63b8-4253-8fd1-2927af9f849f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:51.905895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9816f-63b8-4253-8fd1-2927af9f849f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:51.906200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9816f-63b8-4253-8fd1-2927af9f849f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:51.907022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9816f-63b8-4253-8fd1-2927af9f849f None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=095d08efabf8413985ea367011583248, user.id=d854308aab05463d9641114b751f890d) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:51.907334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9816f-63b8-4253-8fd1-2927af9f849f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:51.908753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9816f-63b8-4253-8fd1-2927af9f849f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:51.914462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 566/1161] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:30:51 2022] GET /identity/v3/role_assignments?user.id=d854308aab05463d9641114b751f890d&scope.project.id=095d08efabf8413985ea367011583248&role.id=308d9785120a49079e02659953a2b033 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:30:54.078588 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72def2-d3e0-4599-b14e-c16fd3b6976b None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:54.079109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72def2-d3e0-4599-b14e-c16fd3b6976b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:54.079220 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72def2-d3e0-4599-b14e-c16fd3b6976b None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:54.080496 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 596/1162] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:54.085905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1bbe3-5e84-4f92-9e82-4d114707b127 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:54.086345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1bbe3-5e84-4f92-9e82-4d114707b127 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:54.086498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e1bbe3-5e84-4f92-9e82-4d114707b127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:54.103401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-b1e1bbe3-5e84-4f92-9e82-4d114707b127 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:54.104628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b1e1bbe3-5e84-4f92-9e82-4d114707b127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:54.168876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 567/1163] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:54.192115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72def2-d3e0-4599-b14e-c16fd3b6976b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:54.216975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:54.292486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72def2-d3e0-4599-b14e-c16fd3b6976b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:54.326318 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561460da-cfed-45a4-b289-deafd016b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:54.326980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561460da-cfed-45a4-b289-deafd016b62b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:54.327266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561460da-cfed-45a4-b289-deafd016b62b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:54.327541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561460da-cfed-45a4-b289-deafd016b62b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:54.392497 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561460da-cfed-45a4-b289-deafd016b62b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:54.393877 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561460da-cfed-45a4-b289-deafd016b62b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:54.416834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:54.489373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 597/1164] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:30:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:30:54.495364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1bbe3-5e84-4f92-9e82-4d114707b127 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:54.586377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:54.592602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e1bbe3-5e84-4f92-9e82-4d114707b127 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:54.625827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d234dc-d8b7-46ab-831e-a4699fec2498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:54.626642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d234dc-d8b7-46ab-831e-a4699fec2498 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:54.626929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d234dc-d8b7-46ab-831e-a4699fec2498 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:54.627207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d234dc-d8b7-46ab-831e-a4699fec2498 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:54.633729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d234dc-d8b7-46ab-831e-a4699fec2498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:54.635464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d234dc-d8b7-46ab-831e-a4699fec2498 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-67d234dc-d8b7-46ab-831e-a4699fec2498 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:30:54.650070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:30:54.651286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:30:54.652212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 568/1165] 10.222.0.79 () {56 vars in 1117 bytes} [Wed May 25 14:30:54 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:30:54.657020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561460da-cfed-45a4-b289-deafd016b62b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:54.751920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561460da-cfed-45a4-b289-deafd016b62b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:54.774727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:54.785327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3aa4f-4849-455d-ae42-778b1789e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:54.785973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3aa4f-4849-455d-ae42-778b1789e2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:54.786282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3aa4f-4849-455d-ae42-778b1789e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:54.786559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3aa4f-4849-455d-ae42-778b1789e2f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:54.787270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3aa4f-4849-455d-ae42-778b1789e2f1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:30:54.787575 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3aa4f-4849-455d-ae42-778b1789e2f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:54.788928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3aa4f-4849-455d-ae42-778b1789e2f1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:54.796284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 598/1166] 10.222.0.79 () {56 vars in 1115 bytes} [Wed May 25 14:30:54 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:56.944148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e1291-b27d-4cd3-923f-03ba95d0c95b None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:56.944657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e1291-b27d-4cd3-923f-03ba95d0c95b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:56.944749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e1291-b27d-4cd3-923f-03ba95d0c95b None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:56.946047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 569/1167] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:56.951463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acab4b-0381-48ed-8675-61eda4ea7e18 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:56.951938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acab4b-0381-48ed-8675-61eda4ea7e18 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:56.952566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acab4b-0381-48ed-8675-61eda4ea7e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:56.968843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-83acab4b-0381-48ed-8675-61eda4ea7e18 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:56.970012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-83acab4b-0381-48ed-8675-61eda4ea7e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:57.033909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 599/1168] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:57.056276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e1291-b27d-4cd3-923f-03ba95d0c95b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:57.154456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e1291-b27d-4cd3-923f-03ba95d0c95b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:57.189328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e93863-c498-45ea-984b-02be44d58450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:57.189959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e93863-c498-45ea-984b-02be44d58450 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:57.190270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e93863-c498-45ea-984b-02be44d58450 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:57.190545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e93863-c498-45ea-984b-02be44d58450 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:57.191265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e93863-c498-45ea-984b-02be44d58450 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:57.192610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e93863-c498-45ea-984b-02be44d58450 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:57.206610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 570/1169] 10.222.0.79 () {60 vars in 1138 bytes} [Wed May 25 14:30:57 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:30:59.376184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecda18-f6a6-42da-952d-f45ce3688c12 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:59.376768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecda18-f6a6-42da-952d-f45ce3688c12 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:59.376768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbecda18-f6a6-42da-952d-f45ce3688c12 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:59.378096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 600/1170] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:30:59.383684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cbcd-1a63-474f-8e4b-b223e3694fdc None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:59.384080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cbcd-1a63-474f-8e4b-b223e3694fdc None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:59.384248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cbcd-1a63-474f-8e4b-b223e3694fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:59.401536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-09c7cbcd-1a63-474f-8e4b-b223e3694fdc None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:30:59.402778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-09c7cbcd-1a63-474f-8e4b-b223e3694fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:30:59.413858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:59.468916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 571/1171] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:30:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:30:59.492528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecda18-f6a6-42da-952d-f45ce3688c12 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:59.590610 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbecda18-f6a6-42da-952d-f45ce3688c12 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:59.606996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:59.623744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcdffce-f038-4d85-9dcb-febd14c7e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:59.624594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdffce-f038-4d85-9dcb-febd14c7e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:59.624903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdffce-f038-4d85-9dcb-febd14c7e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:59.625177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcdffce-f038-4d85-9dcb-febd14c7e7b2 None admin] PATH_INFO: `/v3/domains/658c5dc8e5aa4cb29210f1c7dfcee501` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:59.635454 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdffce-f038-4d85-9dcb-febd14c7e7b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=658c5dc8e5aa4cb29210f1c7dfcee501)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:59.636839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcdffce-f038-4d85-9dcb-febd14c7e7b2 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:59.638465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 601/1172] 10.222.0.79 () {56 vars in 1183 bytes} [Wed May 25 14:30:59 2022] GET /identity/v3/domains/658c5dc8e5aa4cb29210f1c7dfcee501 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:30:59.644163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7cbcd-1a63-474f-8e4b-b223e3694fdc None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:30:59.739758 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7cbcd-1a63-474f-8e4b-b223e3694fdc None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:30:59.772086 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022c27f-c025-4730-a9ec-428a2bfbc9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:30:59.772724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c27f-c025-4730-a9ec-428a2bfbc9b9 None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:30:59.773007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c27f-c025-4730-a9ec-428a2bfbc9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:30:59.773284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022c27f-c025-4730-a9ec-428a2bfbc9b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:30:59.773985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022c27f-c025-4730-a9ec-428a2bfbc9b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:30:59.775435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b022c27f-c025-4730-a9ec-428a2bfbc9b9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:30:59.793702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:30:59.801636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 572/1173] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:30:59 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:31:01.991893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993c125-a64c-405e-8811-6d6eaa6f1b1b None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:01.992429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993c125-a64c-405e-8811-6d6eaa6f1b1b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:01.992429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993c125-a64c-405e-8811-6d6eaa6f1b1b None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:01.993804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 602/1174] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:01.999610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267644d-b644-42b7-88fc-742d36dacf8d None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:02.000025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267644d-b644-42b7-88fc-742d36dacf8d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:02.000162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267644d-b644-42b7-88fc-742d36dacf8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:02.017654 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1267644d-b644-42b7-88fc-742d36dacf8d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:02.018871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1267644d-b644-42b7-88fc-742d36dacf8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:02.082808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 573/1175] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:31:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:02.107006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993c125-a64c-405e-8811-6d6eaa6f1b1b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:02.204565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993c125-a64c-405e-8811-6d6eaa6f1b1b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:02.236072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcf48b7-1fc2-4427-b2b2-43173e453ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:02.236917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf48b7-1fc2-4427-b2b2-43173e453ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:02.237193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf48b7-1fc2-4427-b2b2-43173e453ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:02.237462 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcf48b7-1fc2-4427-b2b2-43173e453ac1 None admin] PATH_INFO: `/v3/domains/658c5dc8e5aa4cb29210f1c7dfcee501` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:02.238637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf48b7-1fc2-4427-b2b2-43173e453ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=658c5dc8e5aa4cb29210f1c7dfcee501)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:02.240058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcf48b7-1fc2-4427-b2b2-43173e453ac1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:02.241606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 603/1176] 10.222.0.79 () {56 vars in 1183 bytes} [Wed May 25 14:31:02 2022] GET /identity/v3/domains/658c5dc8e5aa4cb29210f1c7dfcee501 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:02.247071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267644d-b644-42b7-88fc-742d36dacf8d None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:02.343101 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267644d-b644-42b7-88fc-742d36dacf8d None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:02.368472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:02.376974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d65c105-d3cb-428f-bf60-ba197c2919dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:02.377634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c105-d3cb-428f-bf60-ba197c2919dd None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:02.377917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c105-d3cb-428f-bf60-ba197c2919dd None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:02.378232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d65c105-d3cb-428f-bf60-ba197c2919dd None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:02.378933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65c105-d3cb-428f-bf60-ba197c2919dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:02.380354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d65c105-d3cb-428f-bf60-ba197c2919dd None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:02.399896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 574/1177] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:31:02 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:31:04.604955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c21cd8-84ae-4f50-abc0-07f9f03343f6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:04.605509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c21cd8-84ae-4f50-abc0-07f9f03343f6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:04.605509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c21cd8-84ae-4f50-abc0-07f9f03343f6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:04.606871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 604/1178] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:04.612680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476b08f-4f3e-4550-b4d5-3584678f7b30 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:04.613100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476b08f-4f3e-4550-b4d5-3584678f7b30 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:04.613245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476b08f-4f3e-4550-b4d5-3584678f7b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:04.630300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-6476b08f-4f3e-4550-b4d5-3584678f7b30 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:04.631481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6476b08f-4f3e-4550-b4d5-3584678f7b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:04.695394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 575/1179] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:31:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:04.718030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c21cd8-84ae-4f50-abc0-07f9f03343f6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:04.765663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:04.817419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c21cd8-84ae-4f50-abc0-07f9f03343f6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:04.850722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da48cce-9e98-4e92-aa1e-305098420004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:04.851515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48cce-9e98-4e92-aa1e-305098420004 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:04.851799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48cce-9e98-4e92-aa1e-305098420004 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:04.852074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da48cce-9e98-4e92-aa1e-305098420004 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:04.862212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da48cce-9e98-4e92-aa1e-305098420004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-3da48cce-9e98-4e92-aa1e-305098420004 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:31:04.869893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:04.871079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:04.872186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 605/1180] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:31:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:04.877445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476b08f-4f3e-4550-b4d5-3584678f7b30 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:04.973944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476b08f-4f3e-4550-b4d5-3584678f7b30 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:04.988170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:05.009253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c658e08-f059-4e48-a69e-fc09b95404b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:05.010196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c658e08-f059-4e48-a69e-fc09b95404b0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:05.010481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c658e08-f059-4e48-a69e-fc09b95404b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:05.010755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c658e08-f059-4e48-a69e-fc09b95404b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:05.011506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c658e08-f059-4e48-a69e-fc09b95404b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:05.011812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c658e08-f059-4e48-a69e-fc09b95404b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:05.013182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c658e08-f059-4e48-a69e-fc09b95404b0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:05.021534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 576/1181] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:31:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:05.027145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da48cce-9e98-4e92-aa1e-305098420004 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:05.121939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da48cce-9e98-4e92-aa1e-305098420004 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:05.128965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:05.155789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005a35d-1b24-46b6-b90f-069745ec3519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:05.156640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005a35d-1b24-46b6-b90f-069745ec3519 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:05.156922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005a35d-1b24-46b6-b90f-069745ec3519 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:05.157197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3005a35d-1b24-46b6-b90f-069745ec3519 None admin] PATH_INFO: `/v3/users/6bff1bf2a1904f28abeea95f0ef91260` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:05.169659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005a35d-1b24-46b6-b90f-069745ec3519 None admin] RBAC: Authorizing `identity:get_user(user_id=6bff1bf2a1904f28abeea95f0ef91260)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:05.171183 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3005a35d-1b24-46b6-b90f-069745ec3519 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:05.172789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 606/1182] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:31:05 2022] GET /identity/v3/users/6bff1bf2a1904f28abeea95f0ef91260 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:05.178425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c658e08-f059-4e48-a69e-fc09b95404b0 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:05.275309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c658e08-f059-4e48-a69e-fc09b95404b0 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:05.307767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4641ac6-da66-47df-84bb-0f466e8b0c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:05.308406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4641ac6-da66-47df-84bb-0f466e8b0c63 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:05.308689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4641ac6-da66-47df-84bb-0f466e8b0c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:05.308973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4641ac6-da66-47df-84bb-0f466e8b0c63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:05.352461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:05.375422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4641ac6-da66-47df-84bb-0f466e8b0c63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:05.376810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4641ac6-da66-47df-84bb-0f466e8b0c63 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:05.471470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 577/1183] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:31:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:31:05.477275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005a35d-1b24-46b6-b90f-069745ec3519 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:05.571620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3005a35d-1b24-46b6-b90f-069745ec3519 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:05.604471 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856c75c-3431-4938-b0c8-6f3b3f7660d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:05.605309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c75c-3431-4938-b0c8-6f3b3f7660d0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:05.605830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c75c-3431-4938-b0c8-6f3b3f7660d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:05.605830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856c75c-3431-4938-b0c8-6f3b3f7660d0 None admin] PATH_INFO: `/v3/projects/3644ac860cd4452b987757823fb657ed` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:05.607018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856c75c-3431-4938-b0c8-6f3b3f7660d0 None admin] RBAC: Authorizing `identity:get_project(project_id=3644ac860cd4452b987757823fb657ed)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:05.608960 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856c75c-3431-4938-b0c8-6f3b3f7660d0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:05.610638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 607/1184] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:31:05 2022] GET /identity/v3/projects/3644ac860cd4452b987757823fb657ed => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:05.616431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4641ac6-da66-47df-84bb-0f466e8b0c63 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:05.689587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:05.711401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4641ac6-da66-47df-84bb-0f466e8b0c63 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:05.743796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48210b49-fc8d-4b99-90d0-6d9712156d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:05.744432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48210b49-fc8d-4b99-90d0-6d9712156d06 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:05.744712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48210b49-fc8d-4b99-90d0-6d9712156d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:05.744986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48210b49-fc8d-4b99-90d0-6d9712156d06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:05.745808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48210b49-fc8d-4b99-90d0-6d9712156d06 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=3644ac860cd4452b987757823fb657ed, user.id=6bff1bf2a1904f28abeea95f0ef91260) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:05.746141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48210b49-fc8d-4b99-90d0-6d9712156d06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:05.747560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48210b49-fc8d-4b99-90d0-6d9712156d06 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:05.753327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 578/1185] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:31:05 2022] GET /identity/v3/role_assignments?user.id=6bff1bf2a1904f28abeea95f0ef91260&scope.project.id=3644ac860cd4452b987757823fb657ed&role.id=308d9785120a49079e02659953a2b033 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:07.911554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ecbe-7f9d-4f5a-84b6-a115f241bd17 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:07.912011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ecbe-7f9d-4f5a-84b6-a115f241bd17 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:07.912113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c7ecbe-7f9d-4f5a-84b6-a115f241bd17 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:07.913448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 608/1186] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:31:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:07.918566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9144b-8dd0-4782-9350-5fd06318a7f9 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:07.918949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9144b-8dd0-4782-9350-5fd06318a7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:07.919110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b9144b-8dd0-4782-9350-5fd06318a7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:07.935898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c1b9144b-8dd0-4782-9350-5fd06318a7f9 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:07.937069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c1b9144b-8dd0-4782-9350-5fd06318a7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:08.000690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 579/1187] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:31:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:08.022950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ecbe-7f9d-4f5a-84b6-a115f241bd17 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:08.052632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:08.126555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c7ecbe-7f9d-4f5a-84b6-a115f241bd17 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:08.159004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8836fa0-81a4-439a-895f-35b0c00dced8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:08.159778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8836fa0-81a4-439a-895f-35b0c00dced8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:08.160056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8836fa0-81a4-439a-895f-35b0c00dced8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:08.160324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8836fa0-81a4-439a-895f-35b0c00dced8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:08.169961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8836fa0-81a4-439a-895f-35b0c00dced8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f8836fa0-81a4-439a-895f-35b0c00dced8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:31:08.177715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:08.178930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:31:08.179953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 609/1188] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:31:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:08.185040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9144b-8dd0-4782-9350-5fd06318a7f9 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:08.251325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:08.281813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b9144b-8dd0-4782-9350-5fd06318a7f9 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:08.314220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac839f-18f5-4db0-a971-0e9ec051dbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:08.314867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac839f-18f5-4db0-a971-0e9ec051dbc9 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:08.315145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac839f-18f5-4db0-a971-0e9ec051dbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:08.315416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac839f-18f5-4db0-a971-0e9ec051dbc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:08.316148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac839f-18f5-4db0-a971-0e9ec051dbc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:08.316447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac839f-18f5-4db0-a971-0e9ec051dbc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:08.317788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac839f-18f5-4db0-a971-0e9ec051dbc9 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:08.325586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 580/1189] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:31:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:08.331936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8836fa0-81a4-439a-895f-35b0c00dced8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:08.427662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:08.436391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8836fa0-81a4-439a-895f-35b0c00dced8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:08.469228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10179a3-d277-4b96-9e33-4982b7e088b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:08.470121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10179a3-d277-4b96-9e33-4982b7e088b0 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:08.470410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10179a3-d277-4b96-9e33-4982b7e088b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:08.470688 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10179a3-d277-4b96-9e33-4982b7e088b0 None admin] PATH_INFO: `/v3/users/6bff1bf2a1904f28abeea95f0ef91260` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:08.471865 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10179a3-d277-4b96-9e33-4982b7e088b0 None admin] RBAC: Authorizing `identity:get_user(user_id=6bff1bf2a1904f28abeea95f0ef91260)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:08.473308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10179a3-d277-4b96-9e33-4982b7e088b0 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:08.474955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 610/1190] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:31:08 2022] GET /identity/v3/users/6bff1bf2a1904f28abeea95f0ef91260 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:08.480609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac839f-18f5-4db0-a971-0e9ec051dbc9 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:08.576272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac839f-18f5-4db0-a971-0e9ec051dbc9 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:08.603236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:08.609124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd76d6e-e074-4f0b-97a0-994f3145f65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:08.609973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd76d6e-e074-4f0b-97a0-994f3145f65c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:08.610284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd76d6e-e074-4f0b-97a0-994f3145f65c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:08.610556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd76d6e-e074-4f0b-97a0-994f3145f65c None admin] PATH_INFO: `/v3/projects/3644ac860cd4452b987757823fb657ed` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:08.611730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd76d6e-e074-4f0b-97a0-994f3145f65c None admin] RBAC: Authorizing `identity:get_project(project_id=3644ac860cd4452b987757823fb657ed)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:08.613143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd76d6e-e074-4f0b-97a0-994f3145f65c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:08.614850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 581/1191] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:31:08 2022] GET /identity/v3/projects/3644ac860cd4452b987757823fb657ed => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:08.620739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10179a3-d277-4b96-9e33-4982b7e088b0 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:08.718157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10179a3-d277-4b96-9e33-4982b7e088b0 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:08.750360 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132faac7-e928-46b8-8094-44364e2012b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:08.751229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132faac7-e928-46b8-8094-44364e2012b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:08.751512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132faac7-e928-46b8-8094-44364e2012b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:08.751790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132faac7-e928-46b8-8094-44364e2012b9 None admin] PATH_INFO: `/v3/projects/3644ac860cd4452b987757823fb657ed/users/6bff1bf2a1904f28abeea95f0ef91260/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:08.753730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132faac7-e928-46b8-8094-44364e2012b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3644ac860cd4452b987757823fb657ed, user_id=6bff1bf2a1904f28abeea95f0ef91260, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:08.755192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132faac7-e928-46b8-8094-44364e2012b9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:08.768076 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 611/1192] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:31:08 2022] PUT /identity/v3/projects/3644ac860cd4452b987757823fb657ed/users/6bff1bf2a1904f28abeea95f0ef91260/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:31:10.911356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20a33-5002-4203-b74c-95a5f2dcbd6b None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:10.911823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20a33-5002-4203-b74c-95a5f2dcbd6b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:10.911913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c20a33-5002-4203-b74c-95a5f2dcbd6b None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:10.913266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 582/1193] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:31:10.918642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5eaf0-82b9-4e31-9840-4dbd183a4a63 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:10.919048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5eaf0-82b9-4e31-9840-4dbd183a4a63 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:10.919208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5eaf0-82b9-4e31-9840-4dbd183a4a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:10.936149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5fc5eaf0-82b9-4e31-9840-4dbd183a4a63 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:31:10.937328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5fc5eaf0-82b9-4e31-9840-4dbd183a4a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:31:10.950886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:11.003332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 612/1194] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:31:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:31:11.026341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c20a33-5002-4203-b74c-95a5f2dcbd6b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:11.123993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c20a33-5002-4203-b74c-95a5f2dcbd6b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:11.155931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563ff42-09da-4027-b38a-81266efda090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:11.156695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563ff42-09da-4027-b38a-81266efda090 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:11.156972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563ff42-09da-4027-b38a-81266efda090 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:11.157244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563ff42-09da-4027-b38a-81266efda090 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:11.167271 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1563ff42-09da-4027-b38a-81266efda090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-1563ff42-09da-4027-b38a-81266efda090 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:31:11.174952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:31:11.176011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:31:11.176833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 583/1195] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:31:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:31:11.181801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5eaf0-82b9-4e31-9840-4dbd183a4a63 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:11.276307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5eaf0-82b9-4e31-9840-4dbd183a4a63 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:11.308735 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6460c-5280-43a6-9d24-18a0dd2fa82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:11.309383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6460c-5280-43a6-9d24-18a0dd2fa82c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:11.309664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6460c-5280-43a6-9d24-18a0dd2fa82c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:11.309937 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c6460c-5280-43a6-9d24-18a0dd2fa82c None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:11.310777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6460c-5280-43a6-9d24-18a0dd2fa82c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:11.311084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6460c-5280-43a6-9d24-18a0dd2fa82c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:11.312446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c6460c-5280-43a6-9d24-18a0dd2fa82c None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:11.320201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 613/1196] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:31:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:11.325629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563ff42-09da-4027-b38a-81266efda090 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:11.382528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:11.421622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563ff42-09da-4027-b38a-81266efda090 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:11.453937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f0927-23b8-4270-9830-53daaf3c033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:11.454821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0927-23b8-4270-9830-53daaf3c033c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:11.455102 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0927-23b8-4270-9830-53daaf3c033c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:11.455374 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f0927-23b8-4270-9830-53daaf3c033c None admin] PATH_INFO: `/v3/users/6bff1bf2a1904f28abeea95f0ef91260` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:11.456536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f0927-23b8-4270-9830-53daaf3c033c None admin] RBAC: Authorizing `identity:get_user(user_id=6bff1bf2a1904f28abeea95f0ef91260)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:11.457945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f0927-23b8-4270-9830-53daaf3c033c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:11.459558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 584/1197] 10.222.0.79 () {56 vars in 1177 bytes} [Wed May 25 14:31:11 2022] GET /identity/v3/users/6bff1bf2a1904f28abeea95f0ef91260 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:11.465059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6460c-5280-43a6-9d24-18a0dd2fa82c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:11.480339 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:11.563442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c6460c-5280-43a6-9d24-18a0dd2fa82c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:11.595355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779996d-acb0-4dc6-bd16-9b20b108a49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:11.595984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779996d-acb0-4dc6-bd16-9b20b108a49d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:11.596264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779996d-acb0-4dc6-bd16-9b20b108a49d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:11.596538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779996d-acb0-4dc6-bd16-9b20b108a49d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:11.661280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779996d-acb0-4dc6-bd16-9b20b108a49d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:11.662739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779996d-acb0-4dc6-bd16-9b20b108a49d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:11.675874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:11.755773 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 614/1198] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:31:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:31:11.761695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f0927-23b8-4270-9830-53daaf3c033c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:11.857665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f0927-23b8-4270-9830-53daaf3c033c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:11.883512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:11.892111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9784c-0080-4c1e-9524-af00af6e172a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:11.892968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9784c-0080-4c1e-9524-af00af6e172a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:11.893247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9784c-0080-4c1e-9524-af00af6e172a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:11.893519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9784c-0080-4c1e-9524-af00af6e172a None admin] PATH_INFO: `/v3/projects/3644ac860cd4452b987757823fb657ed` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:11.894702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9784c-0080-4c1e-9524-af00af6e172a None admin] RBAC: Authorizing `identity:get_project(project_id=3644ac860cd4452b987757823fb657ed)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:11.896124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9784c-0080-4c1e-9524-af00af6e172a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:11.897813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 585/1199] 10.222.0.79 () {56 vars in 1186 bytes} [Wed May 25 14:31:11 2022] GET /identity/v3/projects/3644ac860cd4452b987757823fb657ed => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:11.903774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779996d-acb0-4dc6-bd16-9b20b108a49d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:31:11.999476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779996d-acb0-4dc6-bd16-9b20b108a49d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:31:12.012239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:12.033949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b143667-9359-434d-b7b9-ddb817f7b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:31:12.034620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b143667-9359-434d-b7b9-ddb817f7b155 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:31:12.034905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b143667-9359-434d-b7b9-ddb817f7b155 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:31:12.035183 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b143667-9359-434d-b7b9-ddb817f7b155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:31:12.036011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b143667-9359-434d-b7b9-ddb817f7b155 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=3644ac860cd4452b987757823fb657ed, user.id=6bff1bf2a1904f28abeea95f0ef91260) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:31:12.036324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b143667-9359-434d-b7b9-ddb817f7b155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:31:12.037759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b143667-9359-434d-b7b9-ddb817f7b155 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:31:12.043407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 615/1200] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:31:11 2022] GET /identity/v3/role_assignments?user.id=6bff1bf2a1904f28abeea95f0ef91260&scope.project.id=3644ac860cd4452b987757823fb657ed&role.id=308d9785120a49079e02659953a2b033 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:31:21.887668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:31:22.040889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=12 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:11.475496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fbd66-8d2c-4a5c-bd4b-fd6d7eeafd44 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:11.476093 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fbd66-8d2c-4a5c-bd4b-fd6d7eeafd44 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:11.476093 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fbd66-8d2c-4a5c-bd4b-fd6d7eeafd44 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:11.477604 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 586/1201] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:11.485390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd0f5-48f5-4ed6-989e-c5e808bdb509 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:11.485390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd0f5-48f5-4ed6-989e-c5e808bdb509 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:11.485390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2fd0f5-48f5-4ed6-989e-c5e808bdb509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:11.502212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9e2fd0f5-48f5-4ed6-989e-c5e808bdb509 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:11.503443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9e2fd0f5-48f5-4ed6-989e-c5e808bdb509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:11.583144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 616/1202] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:32:11.608042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fbd66-8d2c-4a5c-bd4b-fd6d7eeafd44 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:11.732276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2fbd66-8d2c-4a5c-bd4b-fd6d7eeafd44 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:11.771207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083729e4-8113-445b-b6c9-386568844724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:11.772063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083729e4-8113-445b-b6c9-386568844724 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:11.772340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083729e4-8113-445b-b6c9-386568844724 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:11.772615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083729e4-8113-445b-b6c9-386568844724 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:11.784943 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083729e4-8113-445b-b6c9-386568844724 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:11.786439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083729e4-8113-445b-b6c9-386568844724 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-083729e4-8113-445b-b6c9-386568844724 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:11.805315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:11.806876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:11.807876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:11.807876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:11.807876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:11.807876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:11.810443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 587/1203] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:11.813514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd0f5-48f5-4ed6-989e-c5e808bdb509 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:11.947446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2fd0f5-48f5-4ed6-989e-c5e808bdb509 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:11.984989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:11.992531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3734ef00-929c-4e83-8e13-055bcf422fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:11.993690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734ef00-929c-4e83-8e13-055bcf422fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:11.994212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734ef00-929c-4e83-8e13-055bcf422fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:11.994726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3734ef00-929c-4e83-8e13-055bcf422fa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:11.996640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734ef00-929c-4e83-8e13-055bcf422fa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:11.997186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734ef00-929c-4e83-8e13-055bcf422fa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:11.998786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3734ef00-929c-4e83-8e13-055bcf422fa1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:12.012479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 617/1204] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:12.018669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083729e4-8113-445b-b6c9-386568844724 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:12.086716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:12.148565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083729e4-8113-445b-b6c9-386568844724 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:12.190824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09651bc-daa9-437d-b3cf-9ddfbf7c728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:12.191503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09651bc-daa9-437d-b3cf-9ddfbf7c728a None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:12.191784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09651bc-daa9-437d-b3cf-9ddfbf7c728a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:12.192065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09651bc-daa9-437d-b3cf-9ddfbf7c728a None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:12.192807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09651bc-daa9-437d-b3cf-9ddfbf7c728a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:12.194377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09651bc-daa9-437d-b3cf-9ddfbf7c728a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:12.216400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 588/1205] 10.222.0.79 () {60 vars in 1132 bytes} [Wed May 25 14:32:12 2022] POST /identity/v3/users => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:32:14.595893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b777d-f53b-441a-b740-8311c8a853bf None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:14.596417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b777d-f53b-441a-b740-8311c8a853bf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:14.596552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b777d-f53b-441a-b740-8311c8a853bf None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:14.598009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 618/1206] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:14.604178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed9a5-11df-489f-8494-e6b96f8d1410 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:14.604645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed9a5-11df-489f-8494-e6b96f8d1410 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:14.604736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed9a5-11df-489f-8494-e6b96f8d1410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:14.623073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-0f2ed9a5-11df-489f-8494-e6b96f8d1410 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:14.624292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0f2ed9a5-11df-489f-8494-e6b96f8d1410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:14.703998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 589/1207] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:32:14.730793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b777d-f53b-441a-b740-8311c8a853bf None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:14.859321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b777d-f53b-441a-b740-8311c8a853bf None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:14.905736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222f37c-3cd3-4d56-8767-40ccff2c7b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:14.906721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222f37c-3cd3-4d56-8767-40ccff2c7b2c None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:14.907031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222f37c-3cd3-4d56-8767-40ccff2c7b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:14.907280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222f37c-3cd3-4d56-8767-40ccff2c7b2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:14.921011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222f37c-3cd3-4d56-8767-40ccff2c7b2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a222f37c-3cd3-4d56-8767-40ccff2c7b2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:32:14.929971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:14.931351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:14.932178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 619/1208] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:32:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:14.937427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed9a5-11df-489f-8494-e6b96f8d1410 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:14.983216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:15.060105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed9a5-11df-489f-8494-e6b96f8d1410 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:15.106446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bafbc-5c6a-48b3-a4f7-448830647663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:15.107039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bafbc-5c6a-48b3-a4f7-448830647663 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:15.107453 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bafbc-5c6a-48b3-a4f7-448830647663 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:15.107752 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58bafbc-5c6a-48b3-a4f7-448830647663 None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:15.108618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bafbc-5c6a-48b3-a4f7-448830647663 None admin] RBAC: Adding query filter params (name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:15.109072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bafbc-5c6a-48b3-a4f7-448830647663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:15.110578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58bafbc-5c6a-48b3-a4f7-448830647663 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:15.120431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 590/1209] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:32:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:15.125948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222f37c-3cd3-4d56-8767-40ccff2c7b2c None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:15.188115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:15.252061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222f37c-3cd3-4d56-8767-40ccff2c7b2c None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:15.291780 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39aef0-3ac6-454b-8f4e-4ca3500df595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:15.293215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39aef0-3ac6-454b-8f4e-4ca3500df595 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:15.293639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39aef0-3ac6-454b-8f4e-4ca3500df595 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:15.293882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de39aef0-3ac6-454b-8f4e-4ca3500df595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:15.306845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39aef0-3ac6-454b-8f4e-4ca3500df595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:15.308500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de39aef0-3ac6-454b-8f4e-4ca3500df595 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-de39aef0-3ac6-454b-8f4e-4ca3500df595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:15.328782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:15.329979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:15.335983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:15.335983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:15.335983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:15.335983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:15.335983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 620/1210] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:32:15.336337 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bafbc-5c6a-48b3-a4f7-448830647663 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:15.450726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:15.457436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58bafbc-5c6a-48b3-a4f7-448830647663 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:15.497308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265148d-65fa-4585-9933-8a5c8a0ac60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:15.497967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265148d-65fa-4585-9933-8a5c8a0ac60b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:15.498297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265148d-65fa-4585-9933-8a5c8a0ac60b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:15.498594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265148d-65fa-4585-9933-8a5c8a0ac60b None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:15.499290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265148d-65fa-4585-9933-8a5c8a0ac60b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:15.499597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265148d-65fa-4585-9933-8a5c8a0ac60b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:15.500977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265148d-65fa-4585-9933-8a5c8a0ac60b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:15.519395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 591/1211] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:15.520333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39aef0-3ac6-454b-8f4e-4ca3500df595 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:15.634056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de39aef0-3ac6-454b-8f4e-4ca3500df595 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:15.637552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:15.675379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea237b7-c331-47cf-b020-0823c1fdecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:15.677406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea237b7-c331-47cf-b020-0823c1fdecf8 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:15.677406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea237b7-c331-47cf-b020-0823c1fdecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:15.677406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea237b7-c331-47cf-b020-0823c1fdecf8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:15.685204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea237b7-c331-47cf-b020-0823c1fdecf8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:15.686695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea237b7-c331-47cf-b020-0823c1fdecf8 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0ea237b7-c331-47cf-b020-0823c1fdecf8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:32:15.702148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:15.703150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:15.704131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 621/1212] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:15.709053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265148d-65fa-4585-9933-8a5c8a0ac60b None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:15.821188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265148d-65fa-4585-9933-8a5c8a0ac60b None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:15.866349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007295c-557d-4957-9ed2-3332d82cc0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:15.867317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007295c-557d-4957-9ed2-3332d82cc0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:15.867814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007295c-557d-4957-9ed2-3332d82cc0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:15.868092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007295c-557d-4957-9ed2-3332d82cc0f3 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:15.868973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007295c-557d-4957-9ed2-3332d82cc0f3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:15.869304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007295c-557d-4957-9ed2-3332d82cc0f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:15.871387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007295c-557d-4957-9ed2-3332d82cc0f3 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:15.892087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 592/1213] 10.222.0.79 () {56 vars in 1143 bytes} [Wed May 25 14:32:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:15.898313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea237b7-c331-47cf-b020-0823c1fdecf8 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:16.015915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea237b7-c331-47cf-b020-0823c1fdecf8 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:16.054585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a7c8f-a7a6-4928-ac96-4ee786e0859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:16.055240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a7c8f-a7a6-4928-ac96-4ee786e0859f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:16.055535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a7c8f-a7a6-4928-ac96-4ee786e0859f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:16.055819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a7c8f-a7a6-4928-ac96-4ee786e0859f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:16.093137 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:16.145164 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a7c8f-a7a6-4928-ac96-4ee786e0859f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:16.146850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a7c8f-a7a6-4928-ac96-4ee786e0859f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:16.259750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 622/1214] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:32:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:32:16.266012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007295c-557d-4957-9ed2-3332d82cc0f3 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:16.288422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:16.426607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007295c-557d-4957-9ed2-3332d82cc0f3 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:16.472177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e9fb8-3197-4f35-b12d-bcf6c2d8bbcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:16.473398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9fb8-3197-4f35-b12d-bcf6c2d8bbcf None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:16.473932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9fb8-3197-4f35-b12d-bcf6c2d8bbcf None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:16.474308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e9fb8-3197-4f35-b12d-bcf6c2d8bbcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:16.486886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e9fb8-3197-4f35-b12d-bcf6c2d8bbcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:16.488464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e9fb8-3197-4f35-b12d-bcf6c2d8bbcf None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-3a0e9fb8-3197-4f35-b12d-bcf6c2d8bbcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:16.508687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:16.512206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:16.514761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:16.514761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:16.514761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:16.514761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:16.521237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 593/1215] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:16.521375 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a7c8f-a7a6-4928-ac96-4ee786e0859f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:16.608212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:16.657230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a7c8f-a7a6-4928-ac96-4ee786e0859f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:16.696459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a55b-c0a1-4308-b43c-8f86e6d607d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:16.698410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a55b-c0a1-4308-b43c-8f86e6d607d5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:16.698745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a55b-c0a1-4308-b43c-8f86e6d607d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:16.699282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447a55b-c0a1-4308-b43c-8f86e6d607d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:16.700017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a55b-c0a1-4308-b43c-8f86e6d607d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:16.700328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a55b-c0a1-4308-b43c-8f86e6d607d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:16.701687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447a55b-c0a1-4308-b43c-8f86e6d607d5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:16.717995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 623/1216] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:16.723626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e9fb8-3197-4f35-b12d-bcf6c2d8bbcf None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:16.801144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:16.835656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e9fb8-3197-4f35-b12d-bcf6c2d8bbcf None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:16.877822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bfcfd-3ac0-4c1f-acbe-7aeaf395769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:16.878706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bfcfd-3ac0-4c1f-acbe-7aeaf395769c None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:16.878988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bfcfd-3ac0-4c1f-acbe-7aeaf395769c None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:16.879264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bfcfd-3ac0-4c1f-acbe-7aeaf395769c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:16.886699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bfcfd-3ac0-4c1f-acbe-7aeaf395769c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:16.888157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bfcfd-3ac0-4c1f-acbe-7aeaf395769c None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-6d4bfcfd-3ac0-4c1f-acbe-7aeaf395769c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:32:16.904541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:16.905626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:16.906583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:32:16.906583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:32:16.906583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:32:16.906583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:32:16.906583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:32:16.906583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:32:16.906583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:16.906583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:16.906583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 594/1217] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:32:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:16.911699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a55b-c0a1-4308-b43c-8f86e6d607d5 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:17.021299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447a55b-c0a1-4308-b43c-8f86e6d607d5 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:17.047890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:17.061149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32092192-4763-4572-913d-2e9c71b68519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:17.061788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092192-4763-4572-913d-2e9c71b68519 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:17.062065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092192-4763-4572-913d-2e9c71b68519 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:17.062404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32092192-4763-4572-913d-2e9c71b68519 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:17.063295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32092192-4763-4572-913d-2e9c71b68519 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:17.063610 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32092192-4763-4572-913d-2e9c71b68519 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:17.065238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32092192-4763-4572-913d-2e9c71b68519 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:17.079621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 624/1218] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:32:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:17.086057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bfcfd-3ac0-4c1f-acbe-7aeaf395769c None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:17.198522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bfcfd-3ac0-4c1f-acbe-7aeaf395769c None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:17.231984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:17.239097 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47143db-9104-4141-adb0-a57520708e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:17.239752 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47143db-9104-4141-adb0-a57520708e43 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:17.240033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47143db-9104-4141-adb0-a57520708e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:17.240308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47143db-9104-4141-adb0-a57520708e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:17.241138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47143db-9104-4141-adb0-a57520708e43 None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=582296b1e43f4d12ab99eec9283b0d39) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:17.241451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47143db-9104-4141-adb0-a57520708e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:17.242924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47143db-9104-4141-adb0-a57520708e43 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:17.249266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 595/1219] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:32:17 2022] GET /identity/v3/role_assignments?user.id=582296b1e43f4d12ab99eec9283b0d39&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:19.524784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed58dd-cbe7-4e76-941a-8ac4621a76f9 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:19.525367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed58dd-cbe7-4e76-941a-8ac4621a76f9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:19.525367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed58dd-cbe7-4e76-941a-8ac4621a76f9 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:19.526974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 625/1220] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:32:19.532240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156553-55bd-43fb-9d51-65fa72fc0c74 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:19.532698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156553-55bd-43fb-9d51-65fa72fc0c74 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:19.532873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4156553-55bd-43fb-9d51-65fa72fc0c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:19.550197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e4156553-55bd-43fb-9d51-65fa72fc0c74 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:19.551463 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e4156553-55bd-43fb-9d51-65fa72fc0c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:19.628991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 596/1221] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:32:19.652760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed58dd-cbe7-4e76-941a-8ac4621a76f9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:19.760817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed58dd-cbe7-4e76-941a-8ac4621a76f9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:19.798607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a73a9-1cb0-4495-a932-f5ac1cf43f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:19.799367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a73a9-1cb0-4495-a932-f5ac1cf43f40 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:19.799624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a73a9-1cb0-4495-a932-f5ac1cf43f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:19.799898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a73a9-1cb0-4495-a932-f5ac1cf43f40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:19.810916 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a73a9-1cb0-4495-a932-f5ac1cf43f40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-765a73a9-1cb0-4495-a932-f5ac1cf43f40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:32:19.818777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:19.819719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:32:19.820543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:19.825591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 626/1222] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:32:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:19.826446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4156553-55bd-43fb-9d51-65fa72fc0c74 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:19.932193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4156553-55bd-43fb-9d51-65fa72fc0c74 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:19.958017 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:19.971121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78685f9-a25f-48cb-b8b6-42156c4271cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:19.971842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78685f9-a25f-48cb-b8b6-42156c4271cb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:19.972131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78685f9-a25f-48cb-b8b6-42156c4271cb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:19.972396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78685f9-a25f-48cb-b8b6-42156c4271cb None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:19.973141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78685f9-a25f-48cb-b8b6-42156c4271cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:19.973447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78685f9-a25f-48cb-b8b6-42156c4271cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:19.974889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78685f9-a25f-48cb-b8b6-42156c4271cb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:19.985533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 597/1223] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:32:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:32:19.991776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a73a9-1cb0-4495-a932-f5ac1cf43f40 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:20.048244 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:20.125208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a73a9-1cb0-4495-a932-f5ac1cf43f40 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:20.162902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975e21-a76d-4014-ab7d-b46efe5be4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:20.163731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975e21-a76d-4014-ab7d-b46efe5be4ff None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:20.164008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975e21-a76d-4014-ab7d-b46efe5be4ff None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:20.164275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d975e21-a76d-4014-ab7d-b46efe5be4ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:20.175723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d975e21-a76d-4014-ab7d-b46efe5be4ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:20.177309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d975e21-a76d-4014-ab7d-b46efe5be4ff None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2d975e21-a76d-4014-ab7d-b46efe5be4ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:20.196046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:20.197146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:20.198216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:20.198216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:20.198216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:20.198216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:20.198216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 627/1224] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:20.203041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78685f9-a25f-48cb-b8b6-42156c4271cb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:20.307762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78685f9-a25f-48cb-b8b6-42156c4271cb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:20.344018 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6cdb4-90a5-4ed4-b244-0a47614bbeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:20.344687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6cdb4-90a5-4ed4-b244-0a47614bbeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:20.344972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6cdb4-90a5-4ed4-b244-0a47614bbeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:20.345250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a6cdb4-90a5-4ed4-b244-0a47614bbeb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:20.345980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6cdb4-90a5-4ed4-b244-0a47614bbeb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:20.346318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6cdb4-90a5-4ed4-b244-0a47614bbeb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:20.347699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a6cdb4-90a5-4ed4-b244-0a47614bbeb8 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:20.363367 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 598/1225] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:20.369571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975e21-a76d-4014-ab7d-b46efe5be4ff None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:20.476890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:20.485836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d975e21-a76d-4014-ab7d-b46efe5be4ff None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:20.520732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821a367-1495-43b7-bf34-c139a21ce555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:20.521549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821a367-1495-43b7-bf34-c139a21ce555 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:20.521856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821a367-1495-43b7-bf34-c139a21ce555 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:20.522184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821a367-1495-43b7-bf34-c139a21ce555 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:20.532302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821a367-1495-43b7-bf34-c139a21ce555 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:20.533857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0821a367-1495-43b7-bf34-c139a21ce555 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0821a367-1495-43b7-bf34-c139a21ce555 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:32:20.548861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:20.550016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:20.551204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:20.551204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:20.551204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:32:20.551204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:32:20.551204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:32:20.551204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:32:20.551204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:32:20.551204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:32:20.551204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:20.551204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:20.554929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 628/1226] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:20.556084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6cdb4-90a5-4ed4-b244-0a47614bbeb8 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:20.608542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:20.678533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a6cdb4-90a5-4ed4-b244-0a47614bbeb8 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:20.717724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab88b0-f26f-47dc-80f9-94ad49340ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:20.718469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab88b0-f26f-47dc-80f9-94ad49340ede None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:20.718767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab88b0-f26f-47dc-80f9-94ad49340ede None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:20.719070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab88b0-f26f-47dc-80f9-94ad49340ede None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:20.719960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab88b0-f26f-47dc-80f9-94ad49340ede None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:20.720357 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab88b0-f26f-47dc-80f9-94ad49340ede None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:20.721812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab88b0-f26f-47dc-80f9-94ad49340ede None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:20.741598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 599/1227] 10.222.0.79 () {56 vars in 1143 bytes} [Wed May 25 14:32:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:20.747703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821a367-1495-43b7-bf34-c139a21ce555 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:20.853569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821a367-1495-43b7-bf34-c139a21ce555 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:20.890521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee3634-f560-46e0-bece-c0f6b6bc041d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:20.891348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee3634-f560-46e0-bece-c0f6b6bc041d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:20.891640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee3634-f560-46e0-bece-c0f6b6bc041d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:20.891953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee3634-f560-46e0-bece-c0f6b6bc041d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:20.904211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee3634-f560-46e0-bece-c0f6b6bc041d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:20.905796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee3634-f560-46e0-bece-c0f6b6bc041d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-2eee3634-f560-46e0-bece-c0f6b6bc041d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:20.927627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:20.928971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:20.929927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:20.929927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:20.929927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:20.929927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:20.929927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 629/1228] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:20.935420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab88b0-f26f-47dc-80f9-94ad49340ede None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:21.052940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab88b0-f26f-47dc-80f9-94ad49340ede None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:21.055422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:21.089458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc3186-aa58-41bd-93f9-a65cf8f70425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:21.090151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc3186-aa58-41bd-93f9-a65cf8f70425 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:21.090438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc3186-aa58-41bd-93f9-a65cf8f70425 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:21.090714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc3186-aa58-41bd-93f9-a65cf8f70425 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:21.091433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc3186-aa58-41bd-93f9-a65cf8f70425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:21.091739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc3186-aa58-41bd-93f9-a65cf8f70425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:21.093137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc3186-aa58-41bd-93f9-a65cf8f70425 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:21.105299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 600/1229] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:21.111054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee3634-f560-46e0-bece-c0f6b6bc041d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:21.121297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:21.216506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee3634-f560-46e0-bece-c0f6b6bc041d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:21.252320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeed024-1b06-4771-9b45-5e17b40cc881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:21.253077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeed024-1b06-4771-9b45-5e17b40cc881 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:21.253362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeed024-1b06-4771-9b45-5e17b40cc881 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:21.253635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeed024-1b06-4771-9b45-5e17b40cc881 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:21.260552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeed024-1b06-4771-9b45-5e17b40cc881 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:21.262550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeed024-1b06-4771-9b45-5e17b40cc881 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-6eeed024-1b06-4771-9b45-5e17b40cc881 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:32:21.277459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:21.278564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:21.279740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:32:21.279740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:32:21.279740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:32:21.279740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:32:21.279740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:32:21.279740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:32:21.279740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:21.279740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:21.279740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 630/1230] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:32:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 14:32:21.284473 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc3186-aa58-41bd-93f9-a65cf8f70425 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:21.398851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc3186-aa58-41bd-93f9-a65cf8f70425 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:21.436030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2966dcd-6e2d-4acc-b0cb-f0ff36f438d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:21.436660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2966dcd-6e2d-4acc-b0cb-f0ff36f438d6 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:21.436942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2966dcd-6e2d-4acc-b0cb-f0ff36f438d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:21.437217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2966dcd-6e2d-4acc-b0cb-f0ff36f438d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:21.437996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2966dcd-6e2d-4acc-b0cb-f0ff36f438d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:21.438342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2966dcd-6e2d-4acc-b0cb-f0ff36f438d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:21.439806 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2966dcd-6e2d-4acc-b0cb-f0ff36f438d6 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:21.453103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 601/1231] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:32:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:21.459108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeed024-1b06-4771-9b45-5e17b40cc881 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:21.535224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:21.576239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeed024-1b06-4771-9b45-5e17b40cc881 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:21.613364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a67587-ee6e-44ae-a80a-1dda496dbdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:21.614379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a67587-ee6e-44ae-a80a-1dda496dbdd1 None admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:21.614665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a67587-ee6e-44ae-a80a-1dda496dbdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:21.614940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a67587-ee6e-44ae-a80a-1dda496dbdd1 None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/582296b1e43f4d12ab99eec9283b0d39/roles/f4c0968e3f8b4988a9f32d8ef25d481b` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:21.635378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a67587-ee6e-44ae-a80a-1dda496dbdd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=582296b1e43f4d12ab99eec9283b0d39, role_id=f4c0968e3f8b4988a9f32d8ef25d481b)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:21.637294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a67587-ee6e-44ae-a80a-1dda496dbdd1 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:21.653953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 631/1232] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:32:21 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/582296b1e43f4d12ab99eec9283b0d39/roles/f4c0968e3f8b4988a9f32d8ef25d481b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:32:23.985586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdaa65-aa9c-4dbf-8ca6-304573735891 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:23.986148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdaa65-aa9c-4dbf-8ca6-304573735891 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:23.986148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cdaa65-aa9c-4dbf-8ca6-304573735891 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:23.987531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 602/1233] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:23.992948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a6ba-62fd-4558-a5b0-b106765b8f19 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:23.993379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a6ba-62fd-4558-a5b0-b106765b8f19 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:23.993511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a6ba-62fd-4558-a5b0-b106765b8f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:24.010156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0945a6ba-62fd-4558-a5b0-b106765b8f19 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:24.011863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0945a6ba-62fd-4558-a5b0-b106765b8f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:24.078865 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 632/1234] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:32:24.102325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdaa65-aa9c-4dbf-8ca6-304573735891 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:24.127415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:24.207007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cdaa65-aa9c-4dbf-8ca6-304573735891 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:24.243449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa888f-b1e2-4080-9548-739363c49016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:24.244254 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa888f-b1e2-4080-9548-739363c49016 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:24.244540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa888f-b1e2-4080-9548-739363c49016 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:24.244820 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa888f-b1e2-4080-9548-739363c49016 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:24.255575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa888f-b1e2-4080-9548-739363c49016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-b5aa888f-b1e2-4080-9548-739363c49016 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:32:24.265833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:24.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:24.268060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 603/1235] 10.222.0.79 () {56 vars in 1102 bytes} [Wed May 25 14:32:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:24.273180 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a6ba-62fd-4558-a5b0-b106765b8f19 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:24.322453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:24.381073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a6ba-62fd-4558-a5b0-b106765b8f19 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:24.415791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d5171-361c-4bfa-95ed-2788c717e455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:24.416460 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d5171-361c-4bfa-95ed-2788c717e455 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:24.416741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d5171-361c-4bfa-95ed-2788c717e455 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:24.417044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372d5171-361c-4bfa-95ed-2788c717e455 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:24.417793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d5171-361c-4bfa-95ed-2788c717e455 None admin] RBAC: Adding query filter params (name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:24.418122 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d5171-361c-4bfa-95ed-2788c717e455 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:24.419552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372d5171-361c-4bfa-95ed-2788c717e455 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:24.427919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 633/1236] 10.222.0.79 () {56 vars in 1103 bytes} [Wed May 25 14:32:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:24.433986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa888f-b1e2-4080-9548-739363c49016 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:24.521136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:24.540624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa888f-b1e2-4080-9548-739363c49016 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:24.574364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaab27-dbd9-40e2-8d32-c9ae70859092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:24.575158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaab27-dbd9-40e2-8d32-c9ae70859092 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:24.575440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaab27-dbd9-40e2-8d32-c9ae70859092 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:24.575712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccaab27-dbd9-40e2-8d32-c9ae70859092 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:24.586430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaab27-dbd9-40e2-8d32-c9ae70859092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:24.587902 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccaab27-dbd9-40e2-8d32-c9ae70859092 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-bccaab27-dbd9-40e2-8d32-c9ae70859092 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:24.606405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:24.607625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:24.608638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:24.608638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:24.608638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:24.608638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:24.608638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 604/1237] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:24.613508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d5171-361c-4bfa-95ed-2788c717e455 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:24.723301 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372d5171-361c-4bfa-95ed-2788c717e455 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:24.733908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:24.762394 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0d0a6-65e2-4480-be48-2eb73031662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:24.763177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0d0a6-65e2-4480-be48-2eb73031662a None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:24.763523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0d0a6-65e2-4480-be48-2eb73031662a None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:24.763833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0d0a6-65e2-4480-be48-2eb73031662a None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:24.764653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0d0a6-65e2-4480-be48-2eb73031662a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:24.764997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0d0a6-65e2-4480-be48-2eb73031662a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:24.766628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0d0a6-65e2-4480-be48-2eb73031662a None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:24.780983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 634/1238] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:24.786937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaab27-dbd9-40e2-8d32-c9ae70859092 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:24.901036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccaab27-dbd9-40e2-8d32-c9ae70859092 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:24.939148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21114c58-25c3-4752-8c72-4b731045ff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:24.940175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21114c58-25c3-4752-8c72-4b731045ff31 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:24.940445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21114c58-25c3-4752-8c72-4b731045ff31 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:24.940802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21114c58-25c3-4752-8c72-4b731045ff31 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:24.943882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:24.950509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21114c58-25c3-4752-8c72-4b731045ff31 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:24.952638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21114c58-25c3-4752-8c72-4b731045ff31 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-21114c58-25c3-4752-8c72-4b731045ff31 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:32:24.973412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:24.974565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:24.975546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 605/1239] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:24.980419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0d0a6-65e2-4480-be48-2eb73031662a None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:25.092928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0d0a6-65e2-4480-be48-2eb73031662a None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:25.129761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bb49a-4f88-46eb-93b3-3ef46dab543d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:25.130061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb49a-4f88-46eb-93b3-3ef46dab543d None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:25.130395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb49a-4f88-46eb-93b3-3ef46dab543d None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:25.130680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265bb49a-4f88-46eb-93b3-3ef46dab543d None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:25.131612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bb49a-4f88-46eb-93b3-3ef46dab543d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:25.131965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bb49a-4f88-46eb-93b3-3ef46dab543d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:25.133542 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265bb49a-4f88-46eb-93b3-3ef46dab543d None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:25.152564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 635/1240] 10.222.0.79 () {56 vars in 1143 bytes} [Wed May 25 14:32:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:25.158359 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21114c58-25c3-4752-8c72-4b731045ff31 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:25.268857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21114c58-25c3-4752-8c72-4b731045ff31 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:25.306774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50830185-5a5d-481a-bce2-23a464835efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:25.307417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50830185-5a5d-481a-bce2-23a464835efb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:25.308243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50830185-5a5d-481a-bce2-23a464835efb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:25.308511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50830185-5a5d-481a-bce2-23a464835efb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:25.381979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:25.390721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50830185-5a5d-481a-bce2-23a464835efb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:25.392436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50830185-5a5d-481a-bce2-23a464835efb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:25.494551 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 606/1241] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:32:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:32:25.501305 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bb49a-4f88-46eb-93b3-3ef46dab543d None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:25.531324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:25.607494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265bb49a-4f88-46eb-93b3-3ef46dab543d None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:25.645471 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f7d71-c847-47b5-86f2-5d4f3425f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:25.646262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f7d71-c847-47b5-86f2-5d4f3425f60f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:25.646545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f7d71-c847-47b5-86f2-5d4f3425f60f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:25.646837 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6f7d71-c847-47b5-86f2-5d4f3425f60f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:25.657885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f7d71-c847-47b5-86f2-5d4f3425f60f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:25.659447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6f7d71-c847-47b5-86f2-5d4f3425f60f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-1a6f7d71-c847-47b5-86f2-5d4f3425f60f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:25.678594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:25.679648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:25.680530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:25.680530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:25.680530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:25.680530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:25.680530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 636/1242] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:25.686188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50830185-5a5d-481a-bce2-23a464835efb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:25.783290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:25.789427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50830185-5a5d-481a-bce2-23a464835efb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:25.826466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf9c1-53f5-4db6-a164-5e73da2af27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:25.827295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf9c1-53f5-4db6-a164-5e73da2af27e None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:25.827652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf9c1-53f5-4db6-a164-5e73da2af27e None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:25.827931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf9c1-53f5-4db6-a164-5e73da2af27e None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:25.828749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf9c1-53f5-4db6-a164-5e73da2af27e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:25.829090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf9c1-53f5-4db6-a164-5e73da2af27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:25.830606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf9c1-53f5-4db6-a164-5e73da2af27e None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:25.845891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 607/1243] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:25.851467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f7d71-c847-47b5-86f2-5d4f3425f60f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:25.939783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:25.963468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6f7d71-c847-47b5-86f2-5d4f3425f60f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:26.001293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd636b-6c1c-4260-93e6-01d89a0bb8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:26.002162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd636b-6c1c-4260-93e6-01d89a0bb8ad None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:26.002466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd636b-6c1c-4260-93e6-01d89a0bb8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:26.002779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd636b-6c1c-4260-93e6-01d89a0bb8ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:26.009752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd636b-6c1c-4260-93e6-01d89a0bb8ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:26.011841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd636b-6c1c-4260-93e6-01d89a0bb8ad None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-f7fd636b-6c1c-4260-93e6-01d89a0bb8ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:32:26.026140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:26.027264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:26.028510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:32:26.028510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:32:26.028510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:32:26.028510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:32:26.028510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:32:26.028510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:32:26.028510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:26.028510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:26.028510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 637/1244] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:32:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:26.033175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf9c1-53f5-4db6-a164-5e73da2af27e None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:26.139740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf9c1-53f5-4db6-a164-5e73da2af27e None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:26.173390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425ffdc-9cdf-468a-9461-c94d2e571676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:26.174171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ffdc-9cdf-468a-9461-c94d2e571676 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:26.174325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ffdc-9cdf-468a-9461-c94d2e571676 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:26.174566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425ffdc-9cdf-468a-9461-c94d2e571676 None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:26.175298 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ffdc-9cdf-468a-9461-c94d2e571676 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:26.175606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ffdc-9cdf-468a-9461-c94d2e571676 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:26.177030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425ffdc-9cdf-468a-9461-c94d2e571676 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:26.191476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 608/1245] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:32:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:26.197719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd636b-6c1c-4260-93e6-01d89a0bb8ad None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:26.303640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd636b-6c1c-4260-93e6-01d89a0bb8ad None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:26.344240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529c0f0-b1fc-41b6-9ccf-3aff119305d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:26.344931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c0f0-b1fc-41b6-9ccf-3aff119305d3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:26.345177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c0f0-b1fc-41b6-9ccf-3aff119305d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:26.345452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529c0f0-b1fc-41b6-9ccf-3aff119305d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:26.346321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529c0f0-b1fc-41b6-9ccf-3aff119305d3 None admin] RBAC: Adding query filter params (role.id=f4c0968e3f8b4988a9f32d8ef25d481b, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=582296b1e43f4d12ab99eec9283b0d39) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:26.346636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529c0f0-b1fc-41b6-9ccf-3aff119305d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:26.348070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529c0f0-b1fc-41b6-9ccf-3aff119305d3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:26.353870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 638/1246] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:32:26 2022] GET /identity/v3/role_assignments?user.id=582296b1e43f4d12ab99eec9283b0d39&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=f4c0968e3f8b4988a9f32d8ef25d481b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:32:28.750587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe22e3b-6dbf-44f9-a497-ba15084491d7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:28.751170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe22e3b-6dbf-44f9-a497-ba15084491d7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:28.751170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe22e3b-6dbf-44f9-a497-ba15084491d7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:28.752499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 609/1247] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:28.757995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06784e2-020b-4754-a971-b4e5e420462d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:28.758467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06784e2-020b-4754-a971-b4e5e420462d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:28.758560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06784e2-020b-4754-a971-b4e5e420462d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:28.764908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:28.778273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a06784e2-020b-4754-a971-b4e5e420462d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:28.779493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a06784e2-020b-4754-a971-b4e5e420462d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:28.858314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 639/1248] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:32:28.883246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe22e3b-6dbf-44f9-a497-ba15084491d7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:28.904903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:29.003512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe22e3b-6dbf-44f9-a497-ba15084491d7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:29.040506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e307fb-11bc-4117-a3eb-b905ce7f5128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:29.041334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e307fb-11bc-4117-a3eb-b905ce7f5128 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:29.041608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e307fb-11bc-4117-a3eb-b905ce7f5128 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:29.042035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e307fb-11bc-4117-a3eb-b905ce7f5128 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:29.052936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e307fb-11bc-4117-a3eb-b905ce7f5128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-98e307fb-11bc-4117-a3eb-b905ce7f5128 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:32:29.063153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:29.065652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:29.066532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 610/1249] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:32:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:29.070569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06784e2-020b-4754-a971-b4e5e420462d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:29.184581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06784e2-020b-4754-a971-b4e5e420462d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:29.215909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:29.221434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa850-ef1c-46fb-9d10-6eec65f9f80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:29.222157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa850-ef1c-46fb-9d10-6eec65f9f80b None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:29.222441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa850-ef1c-46fb-9d10-6eec65f9f80b None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:29.222716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65fa850-ef1c-46fb-9d10-6eec65f9f80b None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:29.223470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fa850-ef1c-46fb-9d10-6eec65f9f80b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:29.223780 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fa850-ef1c-46fb-9d10-6eec65f9f80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:29.225301 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65fa850-ef1c-46fb-9d10-6eec65f9f80b None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:29.239453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 640/1250] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:32:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:32:29.240825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e307fb-11bc-4117-a3eb-b905ce7f5128 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:29.320897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:29.345767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e307fb-11bc-4117-a3eb-b905ce7f5128 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:29.381632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ad5c5-1d5c-4488-95f0-6cf1ef0722c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:29.382457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ad5c5-1d5c-4488-95f0-6cf1ef0722c4 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:29.382741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ad5c5-1d5c-4488-95f0-6cf1ef0722c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:29.383020 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ad5c5-1d5c-4488-95f0-6cf1ef0722c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:29.395219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ad5c5-1d5c-4488-95f0-6cf1ef0722c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:29.396658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ad5c5-1d5c-4488-95f0-6cf1ef0722c4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-fa2ad5c5-1d5c-4488-95f0-6cf1ef0722c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:29.415739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:29.417393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:29.418480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:29.418480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:29.418480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:29.418480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:29.418480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 611/1251] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:29.423238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa850-ef1c-46fb-9d10-6eec65f9f80b None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:29.542905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65fa850-ef1c-46fb-9d10-6eec65f9f80b None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:29.585140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c709a-8139-451d-960a-6b72889fadab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:29.586132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c709a-8139-451d-960a-6b72889fadab None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:29.586421 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c709a-8139-451d-960a-6b72889fadab None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:29.586818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c709a-8139-451d-960a-6b72889fadab None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:29.587890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c709a-8139-451d-960a-6b72889fadab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:29.588296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c709a-8139-451d-960a-6b72889fadab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:29.590513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99c709a-8139-451d-960a-6b72889fadab None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:29.612067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 641/1252] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:29.613675 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ad5c5-1d5c-4488-95f0-6cf1ef0722c4 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:29.735202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ad5c5-1d5c-4488-95f0-6cf1ef0722c4 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:29.764112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:29.773324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bc15d-d938-4d61-af1b-89bdf7b88a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:29.773324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bc15d-d938-4d61-af1b-89bdf7b88a17 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:29.773615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bc15d-d938-4d61-af1b-89bdf7b88a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:29.773885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bc15d-d938-4d61-af1b-89bdf7b88a17 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:29.782202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bc15d-d938-4d61-af1b-89bdf7b88a17 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:29.783648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33bc15d-d938-4d61-af1b-89bdf7b88a17 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-a33bc15d-d938-4d61-af1b-89bdf7b88a17 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:32:29.798581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:29.799789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:29.800887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 612/1253] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:29.805737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c709a-8139-451d-960a-6b72889fadab None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:29.870868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:29.922738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c709a-8139-451d-960a-6b72889fadab None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:29.960719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079afbe-b495-4893-a5fe-36cf37b182c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:29.961390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079afbe-b495-4893-a5fe-36cf37b182c3 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:29.961668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079afbe-b495-4893-a5fe-36cf37b182c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:29.961944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079afbe-b495-4893-a5fe-36cf37b182c3 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:29.962853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079afbe-b495-4893-a5fe-36cf37b182c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:29.963165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079afbe-b495-4893-a5fe-36cf37b182c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:29.965145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7079afbe-b495-4893-a5fe-36cf37b182c3 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:29.983556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 642/1254] 10.222.0.79 () {56 vars in 1143 bytes} [Wed May 25 14:32:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:29.989237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bc15d-d938-4d61-af1b-89bdf7b88a17 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:30.097848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bc15d-d938-4d61-af1b-89bdf7b88a17 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:30.134345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2dae-58df-460b-97b7-0ee8d8697ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:30.135184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2dae-58df-460b-97b7-0ee8d8697ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:30.135989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2dae-58df-460b-97b7-0ee8d8697ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:30.136273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c2dae-58df-460b-97b7-0ee8d8697ec0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:30.195488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:30.212321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c2dae-58df-460b-97b7-0ee8d8697ec0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:30.213851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0c2dae-58df-460b-97b7-0ee8d8697ec0 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:30.314732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 613/1255] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:32:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:32:30.320505 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079afbe-b495-4893-a5fe-36cf37b182c3 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:30.429539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079afbe-b495-4893-a5fe-36cf37b182c3 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:30.444663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:30.468177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb938c-8efa-4a05-ae52-4ce9f2ce37d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:30.468990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb938c-8efa-4a05-ae52-4ce9f2ce37d9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:30.469272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb938c-8efa-4a05-ae52-4ce9f2ce37d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:30.469546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb938c-8efa-4a05-ae52-4ce9f2ce37d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:30.480792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb938c-8efa-4a05-ae52-4ce9f2ce37d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:30.482322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb938c-8efa-4a05-ae52-4ce9f2ce37d9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-24cb938c-8efa-4a05-ae52-4ce9f2ce37d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:30.501602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:30.502864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:30.508849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:30.508849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:30.508849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:30.508849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:30.508849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 643/1256] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:30.509220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2dae-58df-460b-97b7-0ee8d8697ec0 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:30.600320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:30.613093 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c2dae-58df-460b-97b7-0ee8d8697ec0 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:30.655605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84824854-246e-4b76-ae8f-b32ab9e1be07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:30.656507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84824854-246e-4b76-ae8f-b32ab9e1be07 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:30.656912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84824854-246e-4b76-ae8f-b32ab9e1be07 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:30.657366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84824854-246e-4b76-ae8f-b32ab9e1be07 None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:30.658503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84824854-246e-4b76-ae8f-b32ab9e1be07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:30.659016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84824854-246e-4b76-ae8f-b32ab9e1be07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:30.660524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84824854-246e-4b76-ae8f-b32ab9e1be07 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:30.674618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 614/1257] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:30.680897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb938c-8efa-4a05-ae52-4ce9f2ce37d9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:30.788173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb938c-8efa-4a05-ae52-4ce9f2ce37d9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:30.824204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b6e97-bfc3-4ce9-9203-7ab85f2b3712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:30.825016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6e97-bfc3-4ce9-9203-7ab85f2b3712 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:30.825299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6e97-bfc3-4ce9-9203-7ab85f2b3712 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:30.825575 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6e97-bfc3-4ce9-9203-7ab85f2b3712 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:30.832841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b6e97-bfc3-4ce9-9203-7ab85f2b3712 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:30.834351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b6e97-bfc3-4ce9-9203-7ab85f2b3712 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-737b6e97-bfc3-4ce9-9203-7ab85f2b3712 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:32:30.848545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:30.849506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:30.850812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:32:30.850812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:32:30.850812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:32:30.850812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:32:30.850812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:32:30.850812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:32:30.850812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:30.850812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:30.850812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 644/1258] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:32:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:30.857436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84824854-246e-4b76-ae8f-b32ab9e1be07 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:30.960208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84824854-246e-4b76-ae8f-b32ab9e1be07 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:30.994648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa69847-534a-42bc-8d19-d6afb4b537bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:30.995355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa69847-534a-42bc-8d19-d6afb4b537bf None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:30.995655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa69847-534a-42bc-8d19-d6afb4b537bf None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:30.995926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa69847-534a-42bc-8d19-d6afb4b537bf None admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:30.996717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa69847-534a-42bc-8d19-d6afb4b537bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:30.997029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa69847-534a-42bc-8d19-d6afb4b537bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:30.998503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa69847-534a-42bc-8d19-d6afb4b537bf None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:31.012362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 615/1259] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:32:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:31.018621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b6e97-bfc3-4ce9-9203-7ab85f2b3712 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:31.045398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:31.125458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b6e97-bfc3-4ce9-9203-7ab85f2b3712 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:31.157737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de583acb-f63d-41d3-a6a6-ad306b51e721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:31.158411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de583acb-f63d-41d3-a6a6-ad306b51e721 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:31.158696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de583acb-f63d-41d3-a6a6-ad306b51e721 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:31.158974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de583acb-f63d-41d3-a6a6-ad306b51e721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:31.159798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de583acb-f63d-41d3-a6a6-ad306b51e721 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=582296b1e43f4d12ab99eec9283b0d39) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:31.160111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de583acb-f63d-41d3-a6a6-ad306b51e721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:31.161537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de583acb-f63d-41d3-a6a6-ad306b51e721 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:31.166853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 645/1260] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:32:31 2022] GET /identity/v3/role_assignments?user.id=582296b1e43f4d12ab99eec9283b0d39&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=308d9785120a49079e02659953a2b033 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:33.299684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b36e8e-9894-45b1-9196-f48fb23dfcac None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:33.300235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b36e8e-9894-45b1-9196-f48fb23dfcac None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:33.300235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b36e8e-9894-45b1-9196-f48fb23dfcac None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:33.301581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 616/1261] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:33.306695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9a5e-9afe-4fad-a504-b721bd8bc926 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:33.307134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9a5e-9afe-4fad-a504-b721bd8bc926 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:33.307254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2d9a5e-9afe-4fad-a504-b721bd8bc926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:33.324236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9d2d9a5e-9afe-4fad-a504-b721bd8bc926 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:33.325413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9d2d9a5e-9afe-4fad-a504-b721bd8bc926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:33.390898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 646/1262] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:32:33.413616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b36e8e-9894-45b1-9196-f48fb23dfcac None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:33.424435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:33.513229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b36e8e-9894-45b1-9196-f48fb23dfcac None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:33.545748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fd0a2-bf28-40f8-ac93-855dd929cb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:33.546549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd0a2-bf28-40f8-ac93-855dd929cb3a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:33.546831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd0a2-bf28-40f8-ac93-855dd929cb3a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:33.547100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fd0a2-bf28-40f8-ac93-855dd929cb3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:33.556744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fd0a2-bf28-40f8-ac93-855dd929cb3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-758fd0a2-bf28-40f8-ac93-855dd929cb3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:32:33.564369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:33.565458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:33.566363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 617/1263] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:32:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:33.571376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d9a5e-9afe-4fad-a504-b721bd8bc926 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:33.589535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:33.676432 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2d9a5e-9afe-4fad-a504-b721bd8bc926 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:33.709551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca4852-ebf5-4b32-b84c-32fd9efa17f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:33.710234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4852-ebf5-4b32-b84c-32fd9efa17f9 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:33.710514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4852-ebf5-4b32-b84c-32fd9efa17f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:33.710785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca4852-ebf5-4b32-b84c-32fd9efa17f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:33.711517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca4852-ebf5-4b32-b84c-32fd9efa17f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:33.711819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca4852-ebf5-4b32-b84c-32fd9efa17f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:33.713180 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca4852-ebf5-4b32-b84c-32fd9efa17f9 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:33.721495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 647/1264] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:32:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:33.727408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fd0a2-bf28-40f8-ac93-855dd929cb3a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:33.792325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:33.824719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fd0a2-bf28-40f8-ac93-855dd929cb3a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:33.856781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a631ac3-61c3-43d7-ba45-ef5b2278ab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:33.857560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a631ac3-61c3-43d7-ba45-ef5b2278ab0f None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:33.857839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a631ac3-61c3-43d7-ba45-ef5b2278ab0f None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:33.858137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a631ac3-61c3-43d7-ba45-ef5b2278ab0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:33.868437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a631ac3-61c3-43d7-ba45-ef5b2278ab0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:33.869891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a631ac3-61c3-43d7-ba45-ef5b2278ab0f None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-6a631ac3-61c3-43d7-ba45-ef5b2278ab0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:33.887047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:33.888052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:33.888989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:33.888989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:33.888989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:33.888989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:33.888989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 618/1265] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:33.893958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca4852-ebf5-4b32-b84c-32fd9efa17f9 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:33.973108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:33.991735 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca4852-ebf5-4b32-b84c-32fd9efa17f9 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:34.023934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1931d2-eb14-4216-9492-b1e3bac17881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:34.024582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1931d2-eb14-4216-9492-b1e3bac17881 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:34.024864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1931d2-eb14-4216-9492-b1e3bac17881 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:34.025136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1931d2-eb14-4216-9492-b1e3bac17881 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:34.025846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1931d2-eb14-4216-9492-b1e3bac17881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:34.026236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1931d2-eb14-4216-9492-b1e3bac17881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:34.027614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1931d2-eb14-4216-9492-b1e3bac17881 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:34.038818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 648/1266] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:34.044828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a631ac3-61c3-43d7-ba45-ef5b2278ab0f None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:34.139946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a631ac3-61c3-43d7-ba45-ef5b2278ab0f None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:34.158794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:34.172840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92aae0c-935a-4fb3-9fe3-13c7249e278a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:34.173618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92aae0c-935a-4fb3-9fe3-13c7249e278a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:34.173896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92aae0c-935a-4fb3-9fe3-13c7249e278a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:34.174193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92aae0c-935a-4fb3-9fe3-13c7249e278a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:34.181227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92aae0c-935a-4fb3-9fe3-13c7249e278a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:34.182720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92aae0c-935a-4fb3-9fe3-13c7249e278a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-d92aae0c-935a-4fb3-9fe3-13c7249e278a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:32:34.196461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:34.197632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:34.199042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 619/1267] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:34.203170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1931d2-eb14-4216-9492-b1e3bac17881 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:34.298669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1931d2-eb14-4216-9492-b1e3bac17881 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:34.330549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5b068-7644-4e9f-af12-1d120f62f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:34.331196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5b068-7644-4e9f-af12-1d120f62f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:34.331474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5b068-7644-4e9f-af12-1d120f62f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:34.331827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e5b068-7644-4e9f-af12-1d120f62f5e4 None admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:34.332653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5b068-7644-4e9f-af12-1d120f62f5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:34.332958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5b068-7644-4e9f-af12-1d120f62f5e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:34.334393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e5b068-7644-4e9f-af12-1d120f62f5e4 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:34.343090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:34.351392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 649/1268] 10.222.0.79 () {56 vars in 1143 bytes} [Wed May 25 14:32:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:34.357362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92aae0c-935a-4fb3-9fe3-13c7249e278a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:34.452717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92aae0c-935a-4fb3-9fe3-13c7249e278a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:34.484657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779f72a-0271-48ed-b9d6-582b7728dfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:34.485429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779f72a-0271-48ed-b9d6-582b7728dfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:34.485708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779f72a-0271-48ed-b9d6-582b7728dfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:34.485980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779f72a-0271-48ed-b9d6-582b7728dfc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:34.496652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779f72a-0271-48ed-b9d6-582b7728dfc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:34.498070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779f72a-0271-48ed-b9d6-582b7728dfc2 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-c779f72a-0271-48ed-b9d6-582b7728dfc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:34.514771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:34.515651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:34.516567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:34.516567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:34.516567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:34.516567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:34.516567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 620/1269] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:34.521416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5b068-7644-4e9f-af12-1d120f62f5e4 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:34.618180 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e5b068-7644-4e9f-af12-1d120f62f5e4 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:34.657789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060b28f-1ea1-4574-ae62-2a72c9376507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:34.658585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060b28f-1ea1-4574-ae62-2a72c9376507 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:34.658898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060b28f-1ea1-4574-ae62-2a72c9376507 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:34.659182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060b28f-1ea1-4574-ae62-2a72c9376507 None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:34.659978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060b28f-1ea1-4574-ae62-2a72c9376507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:34.660280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060b28f-1ea1-4574-ae62-2a72c9376507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:34.661761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060b28f-1ea1-4574-ae62-2a72c9376507 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:34.672770 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 650/1270] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:32:34.678369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779f72a-0271-48ed-b9d6-582b7728dfc2 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:34.709170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:34.774938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779f72a-0271-48ed-b9d6-582b7728dfc2 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:34.806821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9564d76-a798-498b-9a8b-2d3dcd5df8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:34.807625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9564d76-a798-498b-9a8b-2d3dcd5df8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:34.807904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9564d76-a798-498b-9a8b-2d3dcd5df8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:34.808177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9564d76-a798-498b-9a8b-2d3dcd5df8e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:34.814607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9564d76-a798-498b-9a8b-2d3dcd5df8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:34.816037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9564d76-a798-498b-9a8b-2d3dcd5df8e5 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-c9564d76-a798-498b-9a8b-2d3dcd5df8e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:32:34.830410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:34.831419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:34.832746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:32:34.832746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:32:34.832746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:32:34.832746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:32:34.832746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:32:34.832746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:32:34.832746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:34.832746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:34.832746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 621/1271] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:32:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:34.837131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060b28f-1ea1-4574-ae62-2a72c9376507 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:34.894889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:34.935479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060b28f-1ea1-4574-ae62-2a72c9376507 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:34.967947 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f8081-9f51-4a36-a03b-4ca72fce33dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:34.968532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f8081-9f51-4a36-a03b-4ca72fce33dc None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:34.968814 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f8081-9f51-4a36-a03b-4ca72fce33dc None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:34.969090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f8081-9f51-4a36-a03b-4ca72fce33dc None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:34.969899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f8081-9f51-4a36-a03b-4ca72fce33dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:34.970240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f8081-9f51-4a36-a03b-4ca72fce33dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:34.971674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f8081-9f51-4a36-a03b-4ca72fce33dc None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:34.983144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 651/1272] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:32:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:34.988987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9564d76-a798-498b-9a8b-2d3dcd5df8e5 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:35.079898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:35.088582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9564d76-a798-498b-9a8b-2d3dcd5df8e5 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:35.120964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcb39f9-2878-4f27-8f55-8886e723efb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:35.121827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb39f9-2878-4f27-8f55-8886e723efb4 None admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:35.122125 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb39f9-2878-4f27-8f55-8886e723efb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:35.122399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcb39f9-2878-4f27-8f55-8886e723efb4 None admin] PATH_INFO: `/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/582296b1e43f4d12ab99eec9283b0d39/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:35.124300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb39f9-2878-4f27-8f55-8886e723efb4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a1e35ef16bc44919112de05be568ff7, user_id=582296b1e43f4d12ab99eec9283b0d39, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:35.125719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcb39f9-2878-4f27-8f55-8886e723efb4 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:35.142220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 622/1273] 10.222.0.79 () {58 vars in 1439 bytes} [Wed May 25 14:32:34 2022] PUT /identity/v3/projects/4a1e35ef16bc44919112de05be568ff7/users/582296b1e43f4d12ab99eec9283b0d39/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:32:37.282434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c77ed-6dc8-40f1-840e-4a8a7b663932 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:37.282982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c77ed-6dc8-40f1-840e-4a8a7b663932 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:37.282982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c77ed-6dc8-40f1-840e-4a8a7b663932 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:37.284337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 652/1274] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:37.289496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe3cd1-6137-43ce-8d24-1316e66aeeef None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:37.289905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe3cd1-6137-43ce-8d24-1316e66aeeef None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:37.290052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe3cd1-6137-43ce-8d24-1316e66aeeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:37.306464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-f5fe3cd1-6137-43ce-8d24-1316e66aeeef None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:37.308128 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f5fe3cd1-6137-43ce-8d24-1316e66aeeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:37.372804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 623/1275] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:32:37.395853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c77ed-6dc8-40f1-840e-4a8a7b663932 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:37.494182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c77ed-6dc8-40f1-840e-4a8a7b663932 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:37.512248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:37.528458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499c256-dd55-438e-b750-f6cec3c9d73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:37.529235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499c256-dd55-438e-b750-f6cec3c9d73e None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:37.529516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499c256-dd55-438e-b750-f6cec3c9d73e None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:37.529788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a499c256-dd55-438e-b750-f6cec3c9d73e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:37.539522 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a499c256-dd55-438e-b750-f6cec3c9d73e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a499c256-dd55-438e-b750-f6cec3c9d73e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 14:32:37.547682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:37.548772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:37.549823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 653/1276] 10.222.0.79 () {56 vars in 1096 bytes} [Wed May 25 14:32:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:37.556541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe3cd1-6137-43ce-8d24-1316e66aeeef None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:37.636930 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:37.657491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe3cd1-6137-43ce-8d24-1316e66aeeef None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:37.690857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f3092-99d3-4c1a-8f66-8e94a30f185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:37.691510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f3092-99d3-4c1a-8f66-8e94a30f185d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:37.691790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f3092-99d3-4c1a-8f66-8e94a30f185d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:37.692062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f3092-99d3-4c1a-8f66-8e94a30f185d None admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:37.692835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f3092-99d3-4c1a-8f66-8e94a30f185d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:37.693142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f3092-99d3-4c1a-8f66-8e94a30f185d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:37.694529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f3092-99d3-4c1a-8f66-8e94a30f185d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:37.702334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 624/1277] 10.222.0.79 () {56 vars in 1099 bytes} [Wed May 25 14:32:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:37.707945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499c256-dd55-438e-b750-f6cec3c9d73e None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:37.804751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a499c256-dd55-438e-b750-f6cec3c9d73e None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:37.836685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ecf4-d0ec-4f52-9736-1212f484ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:37.837459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ecf4-d0ec-4f52-9736-1212f484ba66 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:37.837738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ecf4-d0ec-4f52-9736-1212f484ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:37.838012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ecf4-d0ec-4f52-9736-1212f484ba66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:37.848804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2ecf4-d0ec-4f52-9736-1212f484ba66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:37.850294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2ecf4-d0ec-4f52-9736-1212f484ba66 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-9cc2ecf4-d0ec-4f52-9736-1212f484ba66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:37.867068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:37.868092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:37.869235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:37.869235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:37.869235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:37.869235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:37.869235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 654/1278] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:37.874335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f3092-99d3-4c1a-8f66-8e94a30f185d None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:37.969381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f3092-99d3-4c1a-8f66-8e94a30f185d None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:38.001529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c415c9b-72f4-416c-a3b7-8078d3ddd2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:38.002220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c415c9b-72f4-416c-a3b7-8078d3ddd2bb None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:38.002505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c415c9b-72f4-416c-a3b7-8078d3ddd2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:38.002783 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c415c9b-72f4-416c-a3b7-8078d3ddd2bb None admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:38.003506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c415c9b-72f4-416c-a3b7-8078d3ddd2bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:38.003815 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c415c9b-72f4-416c-a3b7-8078d3ddd2bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:38.005183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c415c9b-72f4-416c-a3b7-8078d3ddd2bb None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:38.017532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 625/1279] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:38.022980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ecf4-d0ec-4f52-9736-1212f484ba66 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:38.052610 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:38.120918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ecf4-d0ec-4f52-9736-1212f484ba66 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:38.153603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c09ac5-10d0-443c-ad75-0849a5cb91b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:38.154422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c09ac5-10d0-443c-ad75-0849a5cb91b7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:38.154702 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c09ac5-10d0-443c-ad75-0849a5cb91b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:38.154972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c09ac5-10d0-443c-ad75-0849a5cb91b7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:38.162065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c09ac5-10d0-443c-ad75-0849a5cb91b7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:38.163526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c09ac5-10d0-443c-ad75-0849a5cb91b7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-b4c09ac5-10d0-443c-ad75-0849a5cb91b7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 14:32:38.177622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:38.178729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:38.179694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 655/1280] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:38.185208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c415c9b-72f4-416c-a3b7-8078d3ddd2bb None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:38.188912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:38.280253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c415c9b-72f4-416c-a3b7-8078d3ddd2bb None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:38.312349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f8e8-bd3d-473a-a116-e3654375c5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:38.312996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f8e8-bd3d-473a-a116-e3654375c5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:38.313278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f8e8-bd3d-473a-a116-e3654375c5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:38.313550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b19f8e8-bd3d-473a-a116-e3654375c5b1 None admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:38.314400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f8e8-bd3d-473a-a116-e3654375c5b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:38.314706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f8e8-bd3d-473a-a116-e3654375c5b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:38.316142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b19f8e8-bd3d-473a-a116-e3654375c5b1 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:38.332671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 626/1281] 10.222.0.79 () {56 vars in 1143 bytes} [Wed May 25 14:32:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:38.338206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c09ac5-10d0-443c-ad75-0849a5cb91b7 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:38.426778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:38.437094 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c09ac5-10d0-443c-ad75-0849a5cb91b7 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:38.469556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7991a17-5802-4d61-8e8c-e11d1bc2e0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:38.470205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7991a17-5802-4d61-8e8c-e11d1bc2e0ca None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:38.470487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7991a17-5802-4d61-8e8c-e11d1bc2e0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:38.470766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7991a17-5802-4d61-8e8c-e11d1bc2e0ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:38.535978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7991a17-5802-4d61-8e8c-e11d1bc2e0ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:38.537425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7991a17-5802-4d61-8e8c-e11d1bc2e0ca None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:38.623517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:38.636481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 656/1282] 10.222.0.79 () {58 vars in 1282 bytes} [Wed May 25 14:32:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 14:32:38.642928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f8e8-bd3d-473a-a116-e3654375c5b1 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:38.703559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:38.741035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b19f8e8-bd3d-473a-a116-e3654375c5b1 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:38.773096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269dd9e-fa1c-4f9f-a912-3e94b7e66e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:38.773877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269dd9e-fa1c-4f9f-a912-3e94b7e66e9a None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:38.774178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269dd9e-fa1c-4f9f-a912-3e94b7e66e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:38.774450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269dd9e-fa1c-4f9f-a912-3e94b7e66e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:38.784770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269dd9e-fa1c-4f9f-a912-3e94b7e66e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:38.786241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6269dd9e-fa1c-4f9f-a912-3e94b7e66e9a None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-6269dd9e-fa1c-4f9f-a912-3e94b7e66e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 14:32:38.803131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:38.804113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:38.805030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 14:32:38.805030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 14:32:38.805030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 14:32:38.805030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:38.805030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 627/1283] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:32:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:38.810426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7991a17-5802-4d61-8e8c-e11d1bc2e0ca None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:38.906768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7991a17-5802-4d61-8e8c-e11d1bc2e0ca None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:38.947407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8072c8-42ca-4a31-93a9-e3baa69906de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:38.948119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8072c8-42ca-4a31-93a9-e3baa69906de None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:38.948399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8072c8-42ca-4a31-93a9-e3baa69906de None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:38.948671 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8072c8-42ca-4a31-93a9-e3baa69906de None admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:38.949380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8072c8-42ca-4a31-93a9-e3baa69906de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:38.949682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8072c8-42ca-4a31-93a9-e3baa69906de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:38.951138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8072c8-42ca-4a31-93a9-e3baa69906de None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:38.966268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 657/1284] 10.222.0.79 () {56 vars in 1109 bytes} [Wed May 25 14:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:38.971721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269dd9e-fa1c-4f9f-a912-3e94b7e66e9a None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:39.068498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6269dd9e-fa1c-4f9f-a912-3e94b7e66e9a None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:39.082365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:39.102555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400e95e-b2d4-4434-8ebf-788744e1ab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:39.103333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400e95e-b2d4-4434-8ebf-788744e1ab24 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:39.103612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400e95e-b2d4-4434-8ebf-788744e1ab24 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:39.103920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c400e95e-b2d4-4434-8ebf-788744e1ab24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:39.110362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400e95e-b2d4-4434-8ebf-788744e1ab24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:39.111789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c400e95e-b2d4-4434-8ebf-788744e1ab24 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application [None req-c400e95e-b2d4-4434-8ebf-788744e1ab24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 14:32:39.125173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application with Lock( May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:39.126182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:39.127352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 14:32:39.127352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 14:32:39.127352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 14:32:39.127352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 14:32:39.127352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 14:32:39.127352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 14:32:39.127352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 14:32:39.127352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: ERROR keystone.server.flask.application May 25 14:32:39.127352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 628/1285] 10.222.0.79 () {56 vars in 1111 bytes} [Wed May 25 14:32:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:39.132229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8072c8-42ca-4a31-93a9-e3baa69906de None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:39.185794 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:39.239274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8072c8-42ca-4a31-93a9-e3baa69906de None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:39.271988 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ec35db-fac4-41b7-89a4-e1a2654131e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:39.272630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec35db-fac4-41b7-89a4-e1a2654131e7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:39.272908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec35db-fac4-41b7-89a4-e1a2654131e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:39.273181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec35db-fac4-41b7-89a4-e1a2654131e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:39.273949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec35db-fac4-41b7-89a4-e1a2654131e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:39.274282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec35db-fac4-41b7-89a4-e1a2654131e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:39.275706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ec35db-fac4-41b7-89a4-e1a2654131e7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:39.287069 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 658/1286] 10.222.0.79 () {56 vars in 1148 bytes} [Wed May 25 14:32:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:39.293530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400e95e-b2d4-4434-8ebf-788744e1ab24 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:39.389389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c400e95e-b2d4-4434-8ebf-788744e1ab24 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:39.421851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b63d00-aa78-4f8b-b0fd-cbc19093f909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:39.422517 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b63d00-aa78-4f8b-b0fd-cbc19093f909 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:39.422803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b63d00-aa78-4f8b-b0fd-cbc19093f909 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:39.423083 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b63d00-aa78-4f8b-b0fd-cbc19093f909 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:39.423907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b63d00-aa78-4f8b-b0fd-cbc19093f909 None admin] RBAC: Adding query filter params (role.id=308d9785120a49079e02659953a2b033, scope.project.id=4a1e35ef16bc44919112de05be568ff7, user.id=582296b1e43f4d12ab99eec9283b0d39) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:39.424220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b63d00-aa78-4f8b-b0fd-cbc19093f909 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:39.425642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b63d00-aa78-4f8b-b0fd-cbc19093f909 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:39.431320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 629/1287] 10.222.0.79 () {56 vars in 1374 bytes} [Wed May 25 14:32:39 2022] GET /identity/v3/role_assignments?user.id=582296b1e43f4d12ab99eec9283b0d39&scope.project.id=4a1e35ef16bc44919112de05be568ff7&role.id=308d9785120a49079e02659953a2b033 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:41.652956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6d72-6c54-4f87-9331-8b48fcd498da None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:41.653498 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6d72-6c54-4f87-9331-8b48fcd498da None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:41.653612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af6d72-6c54-4f87-9331-8b48fcd498da None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:41.655010 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 659/1288] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:41.661170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401f756-fb79-440e-bd34-f689f6adecfd None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:41.661566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401f756-fb79-440e-bd34-f689f6adecfd None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:41.661730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3401f756-fb79-440e-bd34-f689f6adecfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:41.679573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-3401f756-fb79-440e-bd34-f689f6adecfd None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:41.680629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3401f756-fb79-440e-bd34-f689f6adecfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:41.715697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:41.752631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 630/1289] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:32:41.775235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af6d72-6c54-4f87-9331-8b48fcd498da None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:41.871884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af6d72-6c54-4f87-9331-8b48fcd498da None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:41.882022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:41.905567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b80eb1-3436-4da7-a675-4132f3252b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:41.906385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80eb1-3436-4da7-a675-4132f3252b57 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:41.906759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80eb1-3436-4da7-a675-4132f3252b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:41.907040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b80eb1-3436-4da7-a675-4132f3252b57 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:41.907677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b80eb1-3436-4da7-a675-4132f3252b57 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:41.909034 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b80eb1-3436-4da7-a675-4132f3252b57 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-a5b80eb1-3436-4da7-a675-4132f3252b57 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:41.921299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:41.922529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:41.923397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 660/1290] 10.222.0.79 () {56 vars in 1117 bytes} [Wed May 25 14:32:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:41.928597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401f756-fb79-440e-bd34-f689f6adecfd None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:42.022268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3401f756-fb79-440e-bd34-f689f6adecfd None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:42.054300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8767c6f-de4c-48af-a219-bcc0c60ee71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:42.054939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8767c6f-de4c-48af-a219-bcc0c60ee71d None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:42.055216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8767c6f-de4c-48af-a219-bcc0c60ee71d None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:42.055485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8767c6f-de4c-48af-a219-bcc0c60ee71d None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:42.056174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8767c6f-de4c-48af-a219-bcc0c60ee71d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:42.056474 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8767c6f-de4c-48af-a219-bcc0c60ee71d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:42.057857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8767c6f-de4c-48af-a219-bcc0c60ee71d None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:42.062502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 631/1291] 10.222.0.79 () {56 vars in 1116 bytes} [Wed May 25 14:32:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:32:42.067986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b80eb1-3436-4da7-a675-4132f3252b57 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:42.163184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b80eb1-3436-4da7-a675-4132f3252b57 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:42.194217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770bcf6-0d34-4ce9-a438-8c8e315ff9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:42.194848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770bcf6-0d34-4ce9-a438-8c8e315ff9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:42.195127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770bcf6-0d34-4ce9-a438-8c8e315ff9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:42.195400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770bcf6-0d34-4ce9-a438-8c8e315ff9b7 None admin] PATH_INFO: `/v3/services` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:42.196093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770bcf6-0d34-4ce9-a438-8c8e315ff9b7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:42.196397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770bcf6-0d34-4ce9-a438-8c8e315ff9b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:42.198292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770bcf6-0d34-4ce9-a438-8c8e315ff9b7 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:42.202524 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 661/1292] 10.222.0.79 () {56 vars in 1116 bytes} [Wed May 25 14:32:42 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:44.325870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bbaa7-d2c8-4851-823a-e52fa447a855 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:44.326466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bbaa7-d2c8-4851-823a-e52fa447a855 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:44.326466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bbaa7-d2c8-4851-823a-e52fa447a855 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:44.327802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 632/1293] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:44.332835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998092f-5417-44ea-8739-fe6d5fade4ab None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:44.333222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998092f-5417-44ea-8739-fe6d5fade4ab None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:44.333389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998092f-5417-44ea-8739-fe6d5fade4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:44.350265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4998092f-5417-44ea-8739-fe6d5fade4ab None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:44.351450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4998092f-5417-44ea-8739-fe6d5fade4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:44.379550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:44.416028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 662/1294] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 14:32:44.438323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bbaa7-d2c8-4851-823a-e52fa447a855 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:44.468885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:44.536729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bbaa7-d2c8-4851-823a-e52fa447a855 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:44.569252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5c9a7-9ed6-47f7-a5df-2d71dddfd4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:44.569903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5c9a7-9ed6-47f7-a5df-2d71dddfd4ac None admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:44.570214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5c9a7-9ed6-47f7-a5df-2d71dddfd4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:44.570490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5c9a7-9ed6-47f7-a5df-2d71dddfd4ac None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:44.571198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5c9a7-9ed6-47f7-a5df-2d71dddfd4ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:44.573075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5c9a7-9ed6-47f7-a5df-2d71dddfd4ac None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:44.585309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 633/1295] 10.222.0.79 () {60 vars in 1141 bytes} [Wed May 25 14:32:44 2022] POST /identity/v3/services => generated 246 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:32:46.780016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dfc20-3865-4876-87cf-f67a2acda462 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:46.780579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dfc20-3865-4876-87cf-f67a2acda462 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:46.780579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dfc20-3865-4876-87cf-f67a2acda462 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:46.781930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 663/1296] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:46.787039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221894-39b1-4a85-ad05-e93905fff4bb None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:46.787406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221894-39b1-4a85-ad05-e93905fff4bb None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:46.787600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a221894-39b1-4a85-ad05-e93905fff4bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:46.804356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-8a221894-39b1-4a85-ad05-e93905fff4bb None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:46.805533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8a221894-39b1-4a85-ad05-e93905fff4bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:46.875935 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 634/1297] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:32:46.898595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dfc20-3865-4876-87cf-f67a2acda462 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:46.996761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dfc20-3865-4876-87cf-f67a2acda462 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:47.030391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597499-bcee-4e18-802e-7b2a54e01a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:47.031114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597499-bcee-4e18-802e-7b2a54e01a4f None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:47.031395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597499-bcee-4e18-802e-7b2a54e01a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:47.031669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c597499-bcee-4e18-802e-7b2a54e01a4f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:47.032314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c597499-bcee-4e18-802e-7b2a54e01a4f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:47.033700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c597499-bcee-4e18-802e-7b2a54e01a4f None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0c597499-bcee-4e18-802e-7b2a54e01a4f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:47.045555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:47.046748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:47.047787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 664/1298] 10.222.0.79 () {56 vars in 1117 bytes} [Wed May 25 14:32:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:47.052660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221894-39b1-4a85-ad05-e93905fff4bb None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:47.070678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:47.148867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a221894-39b1-4a85-ad05-e93905fff4bb None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:47.180388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8a541-bdff-4119-b57e-bf1742bddc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:47.181033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8a541-bdff-4119-b57e-bf1742bddc02 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:47.181312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8a541-bdff-4119-b57e-bf1742bddc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:47.181586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd8a541-bdff-4119-b57e-bf1742bddc02 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:47.182821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8a541-bdff-4119-b57e-bf1742bddc02 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:47.183126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8a541-bdff-4119-b57e-bf1742bddc02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:47.184470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd8a541-bdff-4119-b57e-bf1742bddc02 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:47.189426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 635/1299] 10.222.0.79 () {56 vars in 1116 bytes} [Wed May 25 14:32:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:47.195260 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597499-bcee-4e18-802e-7b2a54e01a4f None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:47.226165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:47.292189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c597499-bcee-4e18-802e-7b2a54e01a4f None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:47.324012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033ab23-d46a-49a5-b14f-6ccbcb19efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:47.324649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033ab23-d46a-49a5-b14f-6ccbcb19efc5 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:47.324922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033ab23-d46a-49a5-b14f-6ccbcb19efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:47.325190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033ab23-d46a-49a5-b14f-6ccbcb19efc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:47.325965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033ab23-d46a-49a5-b14f-6ccbcb19efc5 None admin] RBAC: Adding query filter params (interface=public, service_id=6c117518cc1b4291865829ffaab87405, region_id=RegionOne) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:47.326295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033ab23-d46a-49a5-b14f-6ccbcb19efc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:47.327653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033ab23-d46a-49a5-b14f-6ccbcb19efc5 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:47.334716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 665/1300] 10.222.0.79 () {56 vars in 1251 bytes} [Wed May 25 14:32:47 2022] GET /identity/v3/endpoints?service_id=6c117518cc1b4291865829ffaab87405&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:32:47.340261 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8a541-bdff-4119-b57e-bf1742bddc02 None admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:47.419601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:47.437317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd8a541-bdff-4119-b57e-bf1742bddc02 None admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:47.470851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6af94-91b4-43ce-848f-17e995e6bf0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:47.471504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6af94-91b4-43ce-848f-17e995e6bf0b None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:47.471786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6af94-91b4-43ce-848f-17e995e6bf0b None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:47.472059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6af94-91b4-43ce-848f-17e995e6bf0b None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:47.472734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6af94-91b4-43ce-848f-17e995e6bf0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:47.474112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb6af94-91b4-43ce-848f-17e995e6bf0b None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:47.480755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 636/1301] 10.222.0.79 () {56 vars in 1087 bytes} [Wed May 25 14:32:47 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:32:49.624702 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9a938-3bc0-4e65-a1ab-c3670a5980b5 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:49.625266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9a938-3bc0-4e65-a1ab-c3670a5980b5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:49.625266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9a938-3bc0-4e65-a1ab-c3670a5980b5 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:49.626617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 666/1302] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:32:49.631763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df903c27-531f-48cf-b50f-5478958c2c80 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:49.632144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df903c27-531f-48cf-b50f-5478958c2c80 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:49.632324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df903c27-531f-48cf-b50f-5478958c2c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:49.649559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-df903c27-531f-48cf-b50f-5478958c2c80 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:32:49.651371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-df903c27-531f-48cf-b50f-5478958c2c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:32:49.715544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 637/1303] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:32:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 14:32:49.737296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9a938-3bc0-4e65-a1ab-c3670a5980b5 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:49.829055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:49.835735 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9a938-3bc0-4e65-a1ab-c3670a5980b5 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:49.868894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0770-87ad-4cbe-ba79-440d3bc0fd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:49.870289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0770-87ad-4cbe-ba79-440d3bc0fd70 None admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:49.870570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0770-87ad-4cbe-ba79-440d3bc0fd70 None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:49.870841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f0770-87ad-4cbe-ba79-440d3bc0fd70 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:49.871476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f0770-87ad-4cbe-ba79-440d3bc0fd70 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:49.872856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f0770-87ad-4cbe-ba79-440d3bc0fd70 None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application [None req-0f3f0770-87ad-4cbe-ba79-440d3bc0fd70 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 14:32:49.884869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 14:32:49.886024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.get_or_create( May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application with Lock( May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self._enter() May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application return self.creator() May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application created_value = creator( May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: ERROR keystone.server.flask.application May 25 14:32:49.886905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 667/1304] 10.222.0.79 () {56 vars in 1117 bytes} [Wed May 25 14:32:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 14:32:49.891975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df903c27-531f-48cf-b50f-5478958c2c80 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:49.965690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:32:49.988404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df903c27-531f-48cf-b50f-5478958c2c80 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:50.020708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eab67e-998d-4fb0-956d-f4a4b7ad8622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:50.021360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eab67e-998d-4fb0-956d-f4a4b7ad8622 None admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:50.021651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eab67e-998d-4fb0-956d-f4a4b7ad8622 None admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:50.021926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eab67e-998d-4fb0-956d-f4a4b7ad8622 None admin] PATH_INFO: `/v3/services` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:50.022656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eab67e-998d-4fb0-956d-f4a4b7ad8622 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:32:50.022968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eab67e-998d-4fb0-956d-f4a4b7ad8622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:50.024327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eab67e-998d-4fb0-956d-f4a4b7ad8622 None admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:50.029859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 638/1305] 10.222.0.79 () {56 vars in 1116 bytes} [Wed May 25 14:32:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:32:50.035610 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0770-87ad-4cbe-ba79-440d3bc0fd70 None admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:32:50.131682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f0770-87ad-4cbe-ba79-440d3bc0fd70 None admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:32:50.163676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b04dd2-1282-4ceb-929b-0cf4fea2d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:32:50.164327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b04dd2-1282-4ceb-929b-0cf4fea2d0ce None admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:32:50.164605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b04dd2-1282-4ceb-929b-0cf4fea2d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:32:50.164877 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b04dd2-1282-4ceb-929b-0cf4fea2d0ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:32:50.165591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b04dd2-1282-4ceb-929b-0cf4fea2d0ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:32:50.166999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b04dd2-1282-4ceb-929b-0cf4fea2d0ce None admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:32:50.185804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 668/1306] 10.222.0.79 () {60 vars in 1144 bytes} [Wed May 25 14:32:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:33:00.026923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=30 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:00.181028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:53.146206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6b405-87cb-47c8-8b68-8e614abb2fbf None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:53.147056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6b405-87cb-47c8-8b68-8e614abb2fbf None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:53.147056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6b405-87cb-47c8-8b68-8e614abb2fbf None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:53.152632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 639/1307] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:33:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:33:53.154018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f7dfe-423b-4374-a386-2e65b2873250 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:53.154474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f7dfe-423b-4374-a386-2e65b2873250 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:53.154652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f7dfe-423b-4374-a386-2e65b2873250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:53.231933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-675f7dfe-423b-4374-a386-2e65b2873250 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:53.233525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-675f7dfe-423b-4374-a386-2e65b2873250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:53.482217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 669/1308] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:33:53.556574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246eed9-54c2-4cb1-8cba-5c88cda95f09 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:53.556955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246eed9-54c2-4cb1-8cba-5c88cda95f09 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:53.557293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246eed9-54c2-4cb1-8cba-5c88cda95f09 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:53.559268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 640/1309] 10.222.0.79 () {54 vars in 964 bytes} [Wed May 25 14:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:53.565831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e90763-d571-47f5-bd05-4340a1df119e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:53.566140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e90763-d571-47f5-bd05-4340a1df119e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:53.566420 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e90763-d571-47f5-bd05-4340a1df119e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:53.703297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a8e90763-d571-47f5-bd05-4340a1df119e None None] MFA Rules not processed for user `e4270ab375e04196ad17f121f4175915`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:53.704581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a8e90763-d571-47f5-bd05-4340a1df119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:53.726600 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:53.787335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 670/1310] 10.222.0.79 () {58 vars in 1061 bytes} [Wed May 25 14:33:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:53.796176 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246eed9-54c2-4cb1-8cba-5c88cda95f09 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:53.798275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6246eed9-54c2-4cb1-8cba-5c88cda95f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:53.934443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246eed9-54c2-4cb1-8cba-5c88cda95f09 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:54.015953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057cfe7-477a-4dcf-929a-8abcdeca350f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:54.017076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057cfe7-477a-4dcf-929a-8abcdeca350f service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:54.017569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057cfe7-477a-4dcf-929a-8abcdeca350f service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:54.018071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057cfe7-477a-4dcf-929a-8abcdeca350f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:54.019981 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e057cfe7-477a-4dcf-929a-8abcdeca350f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:54.077230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:54.139199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057cfe7-477a-4dcf-929a-8abcdeca350f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:54.141025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057cfe7-477a-4dcf-929a-8abcdeca350f service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:54.176765 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 641/1311] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:56.704697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df6919-a736-4b8e-8118-2b01c3cb088c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:56.705176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df6919-a736-4b8e-8118-2b01c3cb088c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:56.705270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35df6919-a736-4b8e-8118-2b01c3cb088c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:56.706825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 671/1312] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:33:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:56.712376 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805864b9-c78d-4b3c-bf6d-fd03bc6aca49 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:56.712801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805864b9-c78d-4b3c-bf6d-fd03bc6aca49 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:56.712991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805864b9-c78d-4b3c-bf6d-fd03bc6aca49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:56.807075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-805864b9-c78d-4b3c-bf6d-fd03bc6aca49 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:56.808202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-805864b9-c78d-4b3c-bf6d-fd03bc6aca49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:56.907333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 642/1313] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:33:56.944305 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df6919-a736-4b8e-8118-2b01c3cb088c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:56.946459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-35df6919-a736-4b8e-8118-2b01c3cb088c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:57.049731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35df6919-a736-4b8e-8118-2b01c3cb088c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:33:57.123787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:57.126392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb67851-1a57-43d5-a81a-c9fa2514cc57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:33:57.127157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67851-1a57-43d5-a81a-c9fa2514cc57 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:57.127769 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67851-1a57-43d5-a81a-c9fa2514cc57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:57.128350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb67851-1a57-43d5-a81a-c9fa2514cc57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:57.130371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-abb67851-1a57-43d5-a81a-c9fa2514cc57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:57.240670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb67851-1a57-43d5-a81a-c9fa2514cc57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:33:57.242672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb67851-1a57-43d5-a81a-c9fa2514cc57 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:33:57.262166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 672/1314] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:33:59.754243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019b7fc-a605-4162-9b28-1e27d6f4a15c None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:59.754796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019b7fc-a605-4162-9b28-1e27d6f4a15c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:59.754796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019b7fc-a605-4162-9b28-1e27d6f4a15c None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:59.756182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 643/1315] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:33:59.762262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833096-18d0-4b6c-98dc-4e6ff965dc13 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:33:59.762685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833096-18d0-4b6c-98dc-4e6ff965dc13 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:33:59.762818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f833096-18d0-4b6c-98dc-4e6ff965dc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:33:59.826488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3f833096-18d0-4b6c-98dc-4e6ff965dc13 None None] MFA Rules not processed for user `34ed119cc247421babe93929a9f89aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:33:59.827696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3f833096-18d0-4b6c-98dc-4e6ff965dc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:59.878283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:33:59.922857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 673/1316] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:33:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:33:59.962589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019b7fc-a605-4162-9b28-1e27d6f4a15c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:33:59.964141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-2019b7fc-a605-4162-9b28-1e27d6f4a15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:33:59.973801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:00.070631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019b7fc-a605-4162-9b28-1e27d6f4a15c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:00.141904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb77113-5614-485a-821c-faecb4cec5d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:00.142574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb77113-5614-485a-821c-faecb4cec5d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:00.142858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb77113-5614-485a-821c-faecb4cec5d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:00.143132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb77113-5614-485a-821c-faecb4cec5d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:00.144775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9fb77113-5614-485a-821c-faecb4cec5d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:00.204576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:00.250458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb77113-5614-485a-821c-faecb4cec5d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:00.251889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb77113-5614-485a-821c-faecb4cec5d9 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:00.270050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 644/1317] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:33:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:03.021149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb3f93-0282-4674-8772-01c9b02cabba None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:03.021764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb3f93-0282-4674-8772-01c9b02cabba None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:03.021764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb3f93-0282-4674-8772-01c9b02cabba None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:03.023692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 674/1318] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:03.028782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29502c5-e5c1-447e-87d2-74d08b7c6b72 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:03.029170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29502c5-e5c1-447e-87d2-74d08b7c6b72 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:03.029347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29502c5-e5c1-447e-87d2-74d08b7c6b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:03.092122 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a29502c5-e5c1-447e-87d2-74d08b7c6b72 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:03.097210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a29502c5-e5c1-447e-87d2-74d08b7c6b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:03.188986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 645/1319] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:03.240045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14826131-e392-4583-acb9-8f8fe1bf7427 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:03.240335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14826131-e392-4583-acb9-8f8fe1bf7427 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:03.240616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14826131-e392-4583-acb9-8f8fe1bf7427 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:03.242527 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 675/1320] 10.222.0.79 () {54 vars in 964 bytes} [Wed May 25 14:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:03.248140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9accc-c835-48ce-beff-8bf582636ae5 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:03.248429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9accc-c835-48ce-beff-8bf582636ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:03.248708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9accc-c835-48ce-beff-8bf582636ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:03.269519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:03.323037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-89c9accc-c835-48ce-beff-8bf582636ae5 None None] MFA Rules not processed for user `e4270ab375e04196ad17f121f4175915`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:03.324241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-89c9accc-c835-48ce-beff-8bf582636ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:03.397937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 646/1321] 10.222.0.79 () {58 vars in 1061 bytes} [Wed May 25 14:34:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:03.406938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14826131-e392-4583-acb9-8f8fe1bf7427 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:03.408485 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-14826131-e392-4583-acb9-8f8fe1bf7427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:03.509801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14826131-e392-4583-acb9-8f8fe1bf7427 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:03.580364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928adcce-1fc4-4299-bddf-cf9b0895d3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:03.581005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928adcce-1fc4-4299-bddf-cf9b0895d3ea service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:03.581285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928adcce-1fc4-4299-bddf-cf9b0895d3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:03.581554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928adcce-1fc4-4299-bddf-cf9b0895d3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:03.583229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-928adcce-1fc4-4299-bddf-cf9b0895d3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:03.590388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:03.689715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928adcce-1fc4-4299-bddf-cf9b0895d3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:03.691173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928adcce-1fc4-4299-bddf-cf9b0895d3ea service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:03.708418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 676/1322] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:06.973987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79990211-8aa8-493b-91ad-a8a3f3690116 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:06.974531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79990211-8aa8-493b-91ad-a8a3f3690116 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:06.974625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79990211-8aa8-493b-91ad-a8a3f3690116 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:06.975977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 647/1323] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:06.981062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d553-4c45-4305-b50a-4aeef9b624fd None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:06.981486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d553-4c45-4305-b50a-4aeef9b624fd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:06.981628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d553-4c45-4305-b50a-4aeef9b624fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:07.045647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3c07d553-4c45-4305-b50a-4aeef9b624fd None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:07.046871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3c07d553-4c45-4305-b50a-4aeef9b624fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:07.104635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:07.143312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 677/1324] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:07.179162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79990211-8aa8-493b-91ad-a8a3f3690116 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:07.180910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-79990211-8aa8-493b-91ad-a8a3f3690116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:07.283917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79990211-8aa8-493b-91ad-a8a3f3690116 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:07.295984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:07.358659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f06c9c-2afa-4170-8741-677264d59f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:07.359310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f06c9c-2afa-4170-8741-677264d59f74 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:07.359590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f06c9c-2afa-4170-8741-677264d59f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:07.359864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f06c9c-2afa-4170-8741-677264d59f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:07.361501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d4f06c9c-2afa-4170-8741-677264d59f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:07.476563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f06c9c-2afa-4170-8741-677264d59f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:07.478007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f06c9c-2afa-4170-8741-677264d59f74 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:07.496042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 648/1325] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:34:09.765331 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dfdca-263e-4077-aa0c-fdc6f8be95ee None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:09.765889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dfdca-263e-4077-aa0c-fdc6f8be95ee None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:09.765889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2dfdca-263e-4077-aa0c-fdc6f8be95ee None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:09.767284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 678/1326] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:09.773253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c680780-10ea-4db8-b555-8c5b11313af2 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:09.773738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c680780-10ea-4db8-b555-8c5b11313af2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:09.773833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c680780-10ea-4db8-b555-8c5b11313af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:09.821123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:09.839763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-6c680780-10ea-4db8-b555-8c5b11313af2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:09.840997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6c680780-10ea-4db8-b555-8c5b11313af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:09.939829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 649/1327] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:09.975274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dfdca-263e-4077-aa0c-fdc6f8be95ee None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:09.976890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0f2dfdca-263e-4077-aa0c-fdc6f8be95ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:10.082293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2dfdca-263e-4077-aa0c-fdc6f8be95ee None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:10.154578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae46a198-fc7b-4170-8519-1e01e858958d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:10.155221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a198-fc7b-4170-8519-1e01e858958d service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:10.155506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a198-fc7b-4170-8519-1e01e858958d service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:10.155785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae46a198-fc7b-4170-8519-1e01e858958d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:10.157428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ae46a198-fc7b-4170-8519-1e01e858958d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:10.174278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:10.268857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46a198-fc7b-4170-8519-1e01e858958d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:10.270344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae46a198-fc7b-4170-8519-1e01e858958d service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:10.289519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 679/1328] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:12.534871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13035496-7b49-4844-8b6e-e13d604d66eb None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:12.535452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13035496-7b49-4844-8b6e-e13d604d66eb None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:12.535452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13035496-7b49-4844-8b6e-e13d604d66eb None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:12.536774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 650/1329] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:12.542011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf8a3e-8229-4ddb-87e5-9a3880ce60e2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:12.542470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf8a3e-8229-4ddb-87e5-9a3880ce60e2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:12.542746 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacf8a3e-8229-4ddb-87e5-9a3880ce60e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:12.606407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-eacf8a3e-8229-4ddb-87e5-9a3880ce60e2 None None] MFA Rules not processed for user `34ed119cc247421babe93929a9f89aa8`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:12.607594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-eacf8a3e-8229-4ddb-87e5-9a3880ce60e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:12.670491 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:12.704395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 680/1330] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:12.741218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13035496-7b49-4844-8b6e-e13d604d66eb None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:12.742915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-13035496-7b49-4844-8b6e-e13d604d66eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:12.847923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13035496-7b49-4844-8b6e-e13d604d66eb None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:12.871422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:12.924602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744de31-fbbe-40cc-ba6b-d5a8d3b540fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:12.925283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744de31-fbbe-40cc-ba6b-d5a8d3b540fa service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:12.925566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744de31-fbbe-40cc-ba6b-d5a8d3b540fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:12.925843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744de31-fbbe-40cc-ba6b-d5a8d3b540fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:12.927542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3744de31-fbbe-40cc-ba6b-d5a8d3b540fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:13.034889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744de31-fbbe-40cc-ba6b-d5a8d3b540fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:13.036329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744de31-fbbe-40cc-ba6b-d5a8d3b540fa service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:13.054552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 651/1331] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:15.498832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0411-5cdb-462b-9550-9075622f4b2e None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:15.499372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0411-5cdb-462b-9550-9075622f4b2e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:15.499372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a0411-5cdb-462b-9550-9075622f4b2e None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:15.500786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 681/1332] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:15.505864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbeb5b-ed35-4dec-9908-b096957f7960 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:15.506306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbeb5b-ed35-4dec-9908-b096957f7960 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:15.506572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbeb5b-ed35-4dec-9908-b096957f7960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:15.569146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:15.572038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-8bfbeb5b-ed35-4dec-9908-b096957f7960 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:15.573678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8bfbeb5b-ed35-4dec-9908-b096957f7960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:15.671162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 652/1333] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:15.706798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0411-5cdb-462b-9550-9075622f4b2e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:15.708546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-643a0411-5cdb-462b-9550-9075622f4b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:15.811070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a0411-5cdb-462b-9550-9075622f4b2e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:15.886426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924b6f3-9059-4636-b0a3-25a1934004e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:15.887413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924b6f3-9059-4636-b0a3-25a1934004e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:15.887691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924b6f3-9059-4636-b0a3-25a1934004e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:15.887962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924b6f3-9059-4636-b0a3-25a1934004e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:15.889634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7924b6f3-9059-4636-b0a3-25a1934004e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:15.920035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:16.010372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924b6f3-9059-4636-b0a3-25a1934004e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:16.011833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924b6f3-9059-4636-b0a3-25a1934004e4 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:16.030805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 682/1334] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:18.275760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dc731-5943-42bf-8109-6b93c47f28da None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:18.276292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dc731-5943-42bf-8109-6b93c47f28da None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:18.276292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dc731-5943-42bf-8109-6b93c47f28da None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:18.277667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 653/1335] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:18.282730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fc4ed-3806-4637-93bc-cd7ff96cc75f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:18.283110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fc4ed-3806-4637-93bc-cd7ff96cc75f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:18.283290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fc4ed-3806-4637-93bc-cd7ff96cc75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:18.346346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d84fc4ed-3806-4637-93bc-cd7ff96cc75f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:18.347543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d84fc4ed-3806-4637-93bc-cd7ff96cc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:18.421072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:18.443887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 683/1336] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:34:18.483276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dc731-5943-42bf-8109-6b93c47f28da None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:18.484835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f07dc731-5943-42bf-8109-6b93c47f28da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:18.587238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dc731-5943-42bf-8109-6b93c47f28da None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:18.616686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:18.661279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daeba8e-1a97-44fe-b747-75ffb7da9358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:18.661920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daeba8e-1a97-44fe-b747-75ffb7da9358 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:18.662240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daeba8e-1a97-44fe-b747-75ffb7da9358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:18.663045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daeba8e-1a97-44fe-b747-75ffb7da9358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:18.664685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-2daeba8e-1a97-44fe-b747-75ffb7da9358 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:18.770899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daeba8e-1a97-44fe-b747-75ffb7da9358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:18.772386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daeba8e-1a97-44fe-b747-75ffb7da9358 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:18.790306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 654/1337] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:21.390393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e288-4d58-420f-a074-7845135a1d03 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:21.390967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e288-4d58-420f-a074-7845135a1d03 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:21.390967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72e288-4d58-420f-a074-7845135a1d03 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:21.392130 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 684/1338] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:21.397856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e1c68-84df-4892-9247-da587bc27628 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:21.398282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e1c68-84df-4892-9247-da587bc27628 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:21.398456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798e1c68-84df-4892-9247-da587bc27628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:21.461951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-798e1c68-84df-4892-9247-da587bc27628 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:21.463105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-798e1c68-84df-4892-9247-da587bc27628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:21.471370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:21.558287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 655/1339] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:21.595761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72e288-4d58-420f-a074-7845135a1d03 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:21.597360 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fd72e288-4d58-420f-a074-7845135a1d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:21.701355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72e288-4d58-420f-a074-7845135a1d03 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:21.774422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5ff8b-827b-4d9d-a178-3833f9082497 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:21.774986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5ff8b-827b-4d9d-a178-3833f9082497 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:21.775269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5ff8b-827b-4d9d-a178-3833f9082497 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:21.775542 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5ff8b-827b-4d9d-a178-3833f9082497 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:21.777167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7ce5ff8b-827b-4d9d-a178-3833f9082497 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:21.811460 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:21.883625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5ff8b-827b-4d9d-a178-3833f9082497 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:21.885312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5ff8b-827b-4d9d-a178-3833f9082497 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:21.903318 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 685/1340] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:26.000204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8685af-dff2-436a-be50-2dd999f2ac9b None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:26.000733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8685af-dff2-436a-be50-2dd999f2ac9b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:26.000733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8685af-dff2-436a-be50-2dd999f2ac9b None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:26.002248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 656/1341] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:26.007677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7bcbe-6d74-4030-97e6-8abbc6cba844 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:26.008073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7bcbe-6d74-4030-97e6-8abbc6cba844 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:26.008375 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7bcbe-6d74-4030-97e6-8abbc6cba844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:26.088957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f0d7bcbe-6d74-4030-97e6-8abbc6cba844 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:26.090169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f0d7bcbe-6d74-4030-97e6-8abbc6cba844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:26.178508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:26.191493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 686/1342] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:26.231670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8685af-dff2-436a-be50-2dd999f2ac9b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:26.233857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4c8685af-dff2-436a-be50-2dd999f2ac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:26.328909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8685af-dff2-436a-be50-2dd999f2ac9b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:26.332462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c70ca0a-235f-44aa-9d29-dbe05a714b3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:26.333109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70ca0a-235f-44aa-9d29-dbe05a714b3d service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:26.333396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70ca0a-235f-44aa-9d29-dbe05a714b3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:26.333677 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c70ca0a-235f-44aa-9d29-dbe05a714b3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:26.342939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70ca0a-235f-44aa-9d29-dbe05a714b3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:26.344379 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c70ca0a-235f-44aa-9d29-dbe05a714b3d service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:26.353732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 657/1343] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:29.092152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faebcd-1451-4fc3-a6f6-e352281497da None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:29.092666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faebcd-1451-4fc3-a6f6-e352281497da None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:29.092666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1faebcd-1451-4fc3-a6f6-e352281497da None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:29.094032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 687/1344] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:29.099909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae528c-cdf8-475f-ae76-fbef29348545 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:29.100293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae528c-cdf8-475f-ae76-fbef29348545 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:29.100501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae528c-cdf8-475f-ae76-fbef29348545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:29.128543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-f3ae528c-cdf8-475f-ae76-fbef29348545 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:29.129678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f3ae528c-cdf8-475f-ae76-fbef29348545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:29.156597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:29.207615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 658/1345] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:29 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:34:29.244668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faebcd-1451-4fc3-a6f6-e352281497da None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:29.255212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1faebcd-1451-4fc3-a6f6-e352281497da None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:29.258728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d37f54-a79c-4d0b-8057-97537a9b0216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:29.259606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37f54-a79c-4d0b-8057-97537a9b0216 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:29.259992 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37f54-a79c-4d0b-8057-97537a9b0216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:29.260265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d37f54-a79c-4d0b-8057-97537a9b0216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:29.269144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d37f54-a79c-4d0b-8057-97537a9b0216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:29.270620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d37f54-a79c-4d0b-8057-97537a9b0216 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:29.279776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 688/1346] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:29 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:33.455693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf211845-10a9-43af-86fb-8f3f9f9f2331 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:33.456272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf211845-10a9-43af-86fb-8f3f9f9f2331 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:33.456272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf211845-10a9-43af-86fb-8f3f9f9f2331 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:33.457689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 659/1347] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:33.462949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd221a0-3255-44c3-aed0-3046e267a82b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:33.463380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd221a0-3255-44c3-aed0-3046e267a82b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:33.463542 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd221a0-3255-44c3-aed0-3046e267a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:33.481979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4fd221a0-3255-44c3-aed0-3046e267a82b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:33.483236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4fd221a0-3255-44c3-aed0-3046e267a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:33.491738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 689/1348] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:33.528379 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf211845-10a9-43af-86fb-8f3f9f9f2331 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:33.539614 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf211845-10a9-43af-86fb-8f3f9f9f2331 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:33.543073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d208d895-b30f-4c77-afc8-d27e2f7c77fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:33.543702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d895-b30f-4c77-afc8-d27e2f7c77fc service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:33.543981 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d895-b30f-4c77-afc8-d27e2f7c77fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:33.544264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d208d895-b30f-4c77-afc8-d27e2f7c77fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:33.553997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d895-b30f-4c77-afc8-d27e2f7c77fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:33.555616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d208d895-b30f-4c77-afc8-d27e2f7c77fc service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:33.565971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 660/1349] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:38.835205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438578a-0faf-4728-8248-f6b57c27ba1c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:38.836004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438578a-0faf-4728-8248-f6b57c27ba1c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:38.836430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a438578a-0faf-4728-8248-f6b57c27ba1c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:38.837976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 690/1350] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:38.843495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad994a-9276-462c-8fca-87d8437f671e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:38.844287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad994a-9276-462c-8fca-87d8437f671e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:38.844732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad994a-9276-462c-8fca-87d8437f671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:38.985783 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a3ad994a-9276-462c-8fca-87d8437f671e None None] MFA Rules not processed for user `582296b1e43f4d12ab99eec9283b0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:38.987077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a3ad994a-9276-462c-8fca-87d8437f671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:39.068484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 661/1351] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:34:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:43.317016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314632b8-b3b6-4b2a-90b1-bdd3ef38f193 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:43.317517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314632b8-b3b6-4b2a-90b1-bdd3ef38f193 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:43.317517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314632b8-b3b6-4b2a-90b1-bdd3ef38f193 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:43.318921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 691/1352] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:43.324493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c27dd-aa42-412b-9b68-d85c8633c94e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:43.325339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c27dd-aa42-412b-9b68-d85c8633c94e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:43.325836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c27dd-aa42-412b-9b68-d85c8633c94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:43.344553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-943c27dd-aa42-412b-9b68-d85c8633c94e None None] MFA Rules not processed for user `582296b1e43f4d12ab99eec9283b0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:43.345749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-943c27dd-aa42-412b-9b68-d85c8633c94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:43.355002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 662/1353] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:34:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:43.476595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=13 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:44.919570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06d0a-b97b-4145-a9f8-48fc568b3a0a None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:44.920178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06d0a-b97b-4145-a9f8-48fc568b3a0a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:44.920178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e06d0a-b97b-4145-a9f8-48fc568b3a0a None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:44.921561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 692/1354] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:34:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:44.926621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577987b-b0fb-4a67-a42e-b7e8c3c1a58c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:44.927605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577987b-b0fb-4a67-a42e-b7e8c3c1a58c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:44.927842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577987b-b0fb-4a67-a42e-b7e8c3c1a58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:44.945496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c577987b-b0fb-4a67-a42e-b7e8c3c1a58c None None] MFA Rules not processed for user `582296b1e43f4d12ab99eec9283b0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:44.946720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c577987b-b0fb-4a67-a42e-b7e8c3c1a58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:44.955071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 663/1355] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:34:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:48.874630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b145c1-5dae-4138-baca-b8a48c91e095 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:48.875159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b145c1-5dae-4138-baca-b8a48c91e095 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:48.875159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b145c1-5dae-4138-baca-b8a48c91e095 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:48.876511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 693/1356] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:48.882258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdde8e-9985-4525-a493-2c3734a2b315 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:48.882643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdde8e-9985-4525-a493-2c3734a2b315 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:48.882893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdde8e-9985-4525-a493-2c3734a2b315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:48.900832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-6fbdde8e-9985-4525-a493-2c3734a2b315 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:48.902012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6fbdde8e-9985-4525-a493-2c3734a2b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:48.909691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 664/1357] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:48.985852 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31c94b-2f6b-43df-9dd9-8363855f9a86 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:48.986444 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31c94b-2f6b-43df-9dd9-8363855f9a86 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:48.986894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31c94b-2f6b-43df-9dd9-8363855f9a86 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:48.988543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 694/1358] 10.222.0.79 () {54 vars in 961 bytes} [Wed May 25 14:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:48.997959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c0b4-43f4-4300-b46a-be3c98fe3495 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:48.998622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c0b4-43f4-4300-b46a-be3c98fe3495 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:48.999260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e77c0b4-43f4-4300-b46a-be3c98fe3495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:49.043505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:49.052717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-8e77c0b4-43f4-4300-b46a-be3c98fe3495 None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:49.054111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8e77c0b4-43f4-4300-b46a-be3c98fe3495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:49.140085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 665/1359] 10.222.0.79 () {58 vars in 1058 bytes} [Wed May 25 14:34:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:49.148615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31c94b-2f6b-43df-9dd9-8363855f9a86 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:49.163539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31c94b-2f6b-43df-9dd9-8363855f9a86 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:49.169151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e643dfd2-e3cb-4648-acb5-3d064138dc4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:49.169885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643dfd2-e3cb-4648-acb5-3d064138dc4a service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:49.170261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643dfd2-e3cb-4648-acb5-3d064138dc4a service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:49.170606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e643dfd2-e3cb-4648-acb5-3d064138dc4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:49.180062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643dfd2-e3cb-4648-acb5-3d064138dc4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:49.181794 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e643dfd2-e3cb-4648-acb5-3d064138dc4a service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:49.191707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 695/1360] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:51.613428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7b54-5cf6-40a4-8d4e-db81bbf67a23 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:51.613938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7b54-5cf6-40a4-8d4e-db81bbf67a23 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:51.614225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7b54-5cf6-40a4-8d4e-db81bbf67a23 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:51.615734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 666/1361] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:51.620933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150267-0c5b-411b-8092-770552b5eccc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:51.621716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150267-0c5b-411b-8092-770552b5eccc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:51.622001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96150267-0c5b-411b-8092-770552b5eccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:51.641338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-96150267-0c5b-411b-8092-770552b5eccc None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:51.642803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-96150267-0c5b-411b-8092-770552b5eccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:51.655103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 696/1362] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:51.700248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a7b54-5cf6-40a4-8d4e-db81bbf67a23 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:51.714769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a7b54-5cf6-40a4-8d4e-db81bbf67a23 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:51.720066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c88c83-b111-49b4-9766-2264e0a51397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:51.720704 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c88c83-b111-49b4-9766-2264e0a51397 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:51.720988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c88c83-b111-49b4-9766-2264e0a51397 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:51.721263 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c88c83-b111-49b4-9766-2264e0a51397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:51.730322 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c88c83-b111-49b4-9766-2264e0a51397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:51.731925 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c88c83-b111-49b4-9766-2264e0a51397 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:51.742128 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 667/1363] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:54.284343 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0371bf-0369-499b-bf10-49e799ada1dc None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:54.284879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0371bf-0369-499b-bf10-49e799ada1dc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:54.284879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0371bf-0369-499b-bf10-49e799ada1dc None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:54.287460 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 697/1364] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:54.292689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd137d73-f211-4a48-b0db-a62b7a3443c9 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:54.293494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd137d73-f211-4a48-b0db-a62b7a3443c9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:54.293936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd137d73-f211-4a48-b0db-a62b7a3443c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:54.316121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-fd137d73-f211-4a48-b0db-a62b7a3443c9 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:54.317913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fd137d73-f211-4a48-b0db-a62b7a3443c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:54.326239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 668/1365] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:54.373513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a22c-2253-4e2e-ba37-cd542ad45a38 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:54.374012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a22c-2253-4e2e-ba37-cd542ad45a38 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:54.374177 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6a22c-2253-4e2e-ba37-cd542ad45a38 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:54.375559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 698/1366] 10.222.0.79 () {54 vars in 961 bytes} [Wed May 25 14:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:54.383406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffee542-5bf9-440d-af6a-215b837931d6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:54.383406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffee542-5bf9-440d-af6a-215b837931d6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:54.383654 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffee542-5bf9-440d-af6a-215b837931d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:54.411857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1ffee542-5bf9-440d-af6a-215b837931d6 None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:54.413131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1ffee542-5bf9-440d-af6a-215b837931d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:54.423039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 669/1367] 10.222.0.79 () {58 vars in 1058 bytes} [Wed May 25 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:54.431818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a22c-2253-4e2e-ba37-cd542ad45a38 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:54.446422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec6a22c-2253-4e2e-ba37-cd542ad45a38 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:54.451996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7e05f-bc88-4e9c-a573-529339813509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:54.452633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e05f-bc88-4e9c-a573-529339813509 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:54.452915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e05f-bc88-4e9c-a573-529339813509 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:54.453192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7e05f-bc88-4e9c-a573-529339813509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:54.461815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7e05f-bc88-4e9c-a573-529339813509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:54.463455 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7e05f-bc88-4e9c-a573-529339813509 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:54.472956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 699/1368] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:56.871599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e3ea4-67f3-4011-8f8f-719942a922b0 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:56.872081 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e3ea4-67f3-4011-8f8f-719942a922b0 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:56.872194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e3ea4-67f3-4011-8f8f-719942a922b0 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:56.873515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 670/1369] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:56.879400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f85b74-c2fe-405f-b2c8-de11dbdfaa34 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:56.879835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f85b74-c2fe-405f-b2c8-de11dbdfaa34 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:56.879960 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f85b74-c2fe-405f-b2c8-de11dbdfaa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:56.898785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e8f85b74-c2fe-405f-b2c8-de11dbdfaa34 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:56.899990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e8f85b74-c2fe-405f-b2c8-de11dbdfaa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:56.914487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 700/1370] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:56.955963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e3ea4-67f3-4011-8f8f-719942a922b0 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:56.973099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e3ea4-67f3-4011-8f8f-719942a922b0 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:56.980973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6900f94a-dcd9-4938-a3ad-79873de2d911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:56.982016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f94a-dcd9-4938-a3ad-79873de2d911 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:56.982493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f94a-dcd9-4938-a3ad-79873de2d911 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:56.982876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6900f94a-dcd9-4938-a3ad-79873de2d911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:56.993484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900f94a-dcd9-4938-a3ad-79873de2d911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:56.995388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6900f94a-dcd9-4938-a3ad-79873de2d911 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:57.007287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 671/1371] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:57.136485 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be9fe-9b05-48f2-8e30-4964b8cc6499 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:57.136779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be9fe-9b05-48f2-8e30-4964b8cc6499 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:57.137066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9be9fe-9b05-48f2-8e30-4964b8cc6499 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:57.138502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 701/1372] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:57.146040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724091-fec4-4bea-b5d1-564f30dd74e5 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:57.146414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724091-fec4-4bea-b5d1-564f30dd74e5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:57.146650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83724091-fec4-4bea-b5d1-564f30dd74e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:57.167431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-83724091-fec4-4bea-b5d1-564f30dd74e5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:57.168582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-83724091-fec4-4bea-b5d1-564f30dd74e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:57.178227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 672/1373] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:57.453250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3e75-26c2-4b01-ac0b-a8051ee5ef79 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:57.453476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3e75-26c2-4b01-ac0b-a8051ee5ef79 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:57.453930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a3e75-26c2-4b01-ac0b-a8051ee5ef79 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:57.455574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 702/1374] 10.222.0.79 () {54 vars in 963 bytes} [Wed May 25 14:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:57.461440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2f9f0-1769-4ef9-9895-8b31b6937f65 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:57.461848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2f9f0-1769-4ef9-9895-8b31b6937f65 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:57.462257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2f9f0-1769-4ef9-9895-8b31b6937f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:57.513567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-fcb2f9f0-1769-4ef9-9895-8b31b6937f65 None None] MFA Rules not processed for user `eacbb2c50c2c464db93b6cff7a10f7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:57.515254 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fcb2f9f0-1769-4ef9-9895-8b31b6937f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:57.583396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 673/1375] 10.222.0.79 () {58 vars in 1060 bytes} [Wed May 25 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:34:57.590980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3e75-26c2-4b01-ac0b-a8051ee5ef79 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:57.602037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a3e75-26c2-4b01-ac0b-a8051ee5ef79 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:57.606279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67ef257-a549-4276-873e-e3fec08a13f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:57.607028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef257-a549-4276-873e-e3fec08a13f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:57.607419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef257-a549-4276-873e-e3fec08a13f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:57.607811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67ef257-a549-4276-873e-e3fec08a13f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:57.617523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ef257-a549-4276-873e-e3fec08a13f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:57.619140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67ef257-a549-4276-873e-e3fec08a13f8 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:57.630016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 703/1376] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:34:59.254933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304251da-a660-472e-b57a-82f78e86f126 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:59.255486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304251da-a660-472e-b57a-82f78e86f126 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:59.255774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304251da-a660-472e-b57a-82f78e86f126 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:59.257253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 674/1377] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:34:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:34:59.263620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdeece-6253-45e3-ab40-ed0fcb6245f0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:59.264149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdeece-6253-45e3-ab40-ed0fcb6245f0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:59.264269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bdeece-6253-45e3-ab40-ed0fcb6245f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:59.283610 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e7bdeece-6253-45e3-ab40-ed0fcb6245f0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:34:59.285005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e7bdeece-6253-45e3-ab40-ed0fcb6245f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:34:59.293475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 704/1378] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:34:59.338833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304251da-a660-472e-b57a-82f78e86f126 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:34:59.354476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304251da-a660-472e-b57a-82f78e86f126 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:34:59.360088 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ba10-2b55-44d4-8380-5f7c8ff341d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:34:59.360762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ba10-2b55-44d4-8380-5f7c8ff341d2 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:34:59.361049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ba10-2b55-44d4-8380-5f7c8ff341d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:34:59.361330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ba10-2b55-44d4-8380-5f7c8ff341d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:34:59.370448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ba10-2b55-44d4-8380-5f7c8ff341d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:34:59.372089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ba10-2b55-44d4-8380-5f7c8ff341d2 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:34:59.376413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:34:59.384252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 675/1379] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:01.652626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfa53e-5eb5-496b-a154-95566614b488 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:01.653461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfa53e-5eb5-496b-a154-95566614b488 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:01.653893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddfa53e-5eb5-496b-a154-95566614b488 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:01.655454 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 705/1380] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:01.661688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ad25-9275-4500-bbbb-5db1fee231d5 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:01.662140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ad25-9275-4500-bbbb-5db1fee231d5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:01.662366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977ad25-9275-4500-bbbb-5db1fee231d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:01.680920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-b977ad25-9275-4500-bbbb-5db1fee231d5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:01.682480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b977ad25-9275-4500-bbbb-5db1fee231d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:01.690929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 676/1381] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:01.736432 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfa53e-5eb5-496b-a154-95566614b488 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:01.751290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddfa53e-5eb5-496b-a154-95566614b488 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:01.756979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f6200-8782-4349-a1b2-5bf35ccc4a00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:01.757755 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6200-8782-4349-a1b2-5bf35ccc4a00 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:01.758196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6200-8782-4349-a1b2-5bf35ccc4a00 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:01.758586 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f6200-8782-4349-a1b2-5bf35ccc4a00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:01.767424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6200-8782-4349-a1b2-5bf35ccc4a00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:01.769174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f6200-8782-4349-a1b2-5bf35ccc4a00 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:01.779732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 706/1382] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:04.022264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3bb2-8ed0-47b6-ba7a-124dff9e07e0 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:04.022813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3bb2-8ed0-47b6-ba7a-124dff9e07e0 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:04.022813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98b3bb2-8ed0-47b6-ba7a-124dff9e07e0 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:04.025320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 677/1383] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:35:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:35:04.029766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e84a-6e17-4e6e-85f6-92db13a51e7b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:04.030591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e84a-6e17-4e6e-85f6-92db13a51e7b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:04.030866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152e84a-6e17-4e6e-85f6-92db13a51e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:04.049999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b152e84a-6e17-4e6e-85f6-92db13a51e7b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:04.051989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b152e84a-6e17-4e6e-85f6-92db13a51e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:04.060030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 707/1384] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:04.103343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3bb2-8ed0-47b6-ba7a-124dff9e07e0 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:04.119422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98b3bb2-8ed0-47b6-ba7a-124dff9e07e0 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:04.125719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9a267-3193-4661-ab9c-eb4bf6c24dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:04.126657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a267-3193-4661-ab9c-eb4bf6c24dba service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:04.127055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a267-3193-4661-ab9c-eb4bf6c24dba service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:04.127443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9a267-3193-4661-ab9c-eb4bf6c24dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:04.138386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9a267-3193-4661-ab9c-eb4bf6c24dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:04.140223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9a267-3193-4661-ab9c-eb4bf6c24dba service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:04.152826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 678/1385] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:06.346774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daac26-ddc1-4577-a5fa-83bb9412066c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:06.347329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daac26-ddc1-4577-a5fa-83bb9412066c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:06.347733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2daac26-ddc1-4577-a5fa-83bb9412066c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:06.349741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 708/1386] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:35:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:06.354958 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c232c-d776-4d07-90e6-6cb3b222cd38 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:06.355530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c232c-d776-4d07-90e6-6cb3b222cd38 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:06.355530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c232c-d776-4d07-90e6-6cb3b222cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:06.373725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d08c232c-d776-4d07-90e6-6cb3b222cd38 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:06.374964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d08c232c-d776-4d07-90e6-6cb3b222cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:06.383478 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 679/1387] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:06.429751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daac26-ddc1-4577-a5fa-83bb9412066c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:06.444712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2daac26-ddc1-4577-a5fa-83bb9412066c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:06.450447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e48af-2c9e-453f-9fdd-ab92290829f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:06.451091 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e48af-2c9e-453f-9fdd-ab92290829f7 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:06.451406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e48af-2c9e-453f-9fdd-ab92290829f7 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:06.451672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e48af-2c9e-453f-9fdd-ab92290829f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:06.460298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e48af-2c9e-453f-9fdd-ab92290829f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:06.461886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e48af-2c9e-453f-9fdd-ab92290829f7 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:06.471911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 709/1388] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:08.763832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c4f9a-7fb5-46d9-a6da-12f250e2ded6 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:08.764469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c4f9a-7fb5-46d9-a6da-12f250e2ded6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:08.764626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c4f9a-7fb5-46d9-a6da-12f250e2ded6 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:08.766350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 680/1389] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:08.773107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3fa98-d725-4964-a184-5c514108b69d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:08.773661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3fa98-d725-4964-a184-5c514108b69d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:08.773754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3fa98-d725-4964-a184-5c514108b69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:08.794975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-25d3fa98-d725-4964-a184-5c514108b69d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:08.795754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-25d3fa98-d725-4964-a184-5c514108b69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:08.806512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 710/1390] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:08.853336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c4f9a-7fb5-46d9-a6da-12f250e2ded6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:08.868107 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c4f9a-7fb5-46d9-a6da-12f250e2ded6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:08.873727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a82f7-ea49-43d7-a73c-bc9254e57f7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:08.874382 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a82f7-ea49-43d7-a73c-bc9254e57f7b service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:08.874712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a82f7-ea49-43d7-a73c-bc9254e57f7b service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:08.874945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a82f7-ea49-43d7-a73c-bc9254e57f7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:08.884952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a82f7-ea49-43d7-a73c-bc9254e57f7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:08.887086 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a82f7-ea49-43d7-a73c-bc9254e57f7b service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:08.900327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 681/1391] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:11.718910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb4754-5c94-4e95-b146-1d63fa786071 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:11.719579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb4754-5c94-4e95-b146-1d63fa786071 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:11.719579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb4754-5c94-4e95-b146-1d63fa786071 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:11.720822 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 711/1392] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:11.726106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab58b1-9262-4089-a0d6-3123069208fd None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:11.726566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab58b1-9262-4089-a0d6-3123069208fd None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:11.726673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab58b1-9262-4089-a0d6-3123069208fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:11.744122 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-2dab58b1-9262-4089-a0d6-3123069208fd None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:11.745312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-2dab58b1-9262-4089-a0d6-3123069208fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:11.753114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 682/1393] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:11.798190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb4754-5c94-4e95-b146-1d63fa786071 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:11.812683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbb4754-5c94-4e95-b146-1d63fa786071 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:11.818639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62b604-7e93-4984-9b24-fe9b126c2eef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:11.819276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62b604-7e93-4984-9b24-fe9b126c2eef service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:11.819563 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62b604-7e93-4984-9b24-fe9b126c2eef service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:11.819936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62b604-7e93-4984-9b24-fe9b126c2eef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:11.828314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62b604-7e93-4984-9b24-fe9b126c2eef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:11.829903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62b604-7e93-4984-9b24-fe9b126c2eef service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:11.840726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 712/1394] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:13.565730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad26144-d78f-43c8-9306-9f24dc8973c4 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:13.566304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad26144-d78f-43c8-9306-9f24dc8973c4 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:13.566304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad26144-d78f-43c8-9306-9f24dc8973c4 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:13.567745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 683/1395] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:13.572923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c45764-205b-4065-9e05-17627c3ef683 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:13.573340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c45764-205b-4065-9e05-17627c3ef683 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:13.573554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c45764-205b-4065-9e05-17627c3ef683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:13.579744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=52 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:35:13.592841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e0c45764-205b-4065-9e05-17627c3ef683 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:13.594040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e0c45764-205b-4065-9e05-17627c3ef683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:13.602836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 713/1396] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:13.658007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e627efa-cd9e-4fda-9028-89bd7b2dc2e2 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:13.658335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e627efa-cd9e-4fda-9028-89bd7b2dc2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:13.658618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e627efa-cd9e-4fda-9028-89bd7b2dc2e2 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:13.659972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 684/1397] 10.222.0.79 () {54 vars in 962 bytes} [Wed May 25 14:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:13.665690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb78858-0d5b-41df-8055-8eda541bccbd None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:13.665987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb78858-0d5b-41df-8055-8eda541bccbd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:13.666302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb78858-0d5b-41df-8055-8eda541bccbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:13.714656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-cfb78858-0d5b-41df-8055-8eda541bccbd None None] MFA Rules not processed for user `0edbf66359f1426999f4c28a83f2bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:13.715873 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cfb78858-0d5b-41df-8055-8eda541bccbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:13.775775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 714/1398] 10.222.0.79 () {58 vars in 1059 bytes} [Wed May 25 14:35:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:13.783519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e627efa-cd9e-4fda-9028-89bd7b2dc2e2 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:13.794488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e627efa-cd9e-4fda-9028-89bd7b2dc2e2 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:13.797921 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f19084-87d1-442e-b0c7-8c1d8da9d282 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0edbf66359f1426999f4c28a83f2bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:13.798583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f19084-87d1-442e-b0c7-8c1d8da9d282 service glance] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:13.798865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f19084-87d1-442e-b0c7-8c1d8da9d282 service glance] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:13.799137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f19084-87d1-442e-b0c7-8c1d8da9d282 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:13.807797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f19084-87d1-442e-b0c7-8c1d8da9d282 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:13.809217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f19084-87d1-442e-b0c7-8c1d8da9d282 service glance] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:13.818748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 685/1399] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:14.075351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda346cb-d6ec-4d73-aabc-5050ac5218dd None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:14.075586 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda346cb-d6ec-4d73-aabc-5050ac5218dd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:14.076026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda346cb-d6ec-4d73-aabc-5050ac5218dd None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:14.077396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 715/1400] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:14.083216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ea40f-3f99-4737-99b3-d7a02dec0741 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:14.083501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ea40f-3f99-4737-99b3-d7a02dec0741 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:14.083777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ea40f-3f99-4737-99b3-d7a02dec0741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:14.102257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-5a0ea40f-3f99-4737-99b3-d7a02dec0741 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:14.103461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5a0ea40f-3f99-4737-99b3-d7a02dec0741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:14.111732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 686/1401] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:14.155288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda346cb-d6ec-4d73-aabc-5050ac5218dd None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:14.169241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda346cb-d6ec-4d73-aabc-5050ac5218dd None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:14.174590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72bbcd-291e-4fe1-b4f2-4f07c1bd7ff1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:14.175214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72bbcd-291e-4fe1-b4f2-4f07c1bd7ff1 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:14.175495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72bbcd-291e-4fe1-b4f2-4f07c1bd7ff1 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:14.175774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72bbcd-291e-4fe1-b4f2-4f07c1bd7ff1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:14.183700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72bbcd-291e-4fe1-b4f2-4f07c1bd7ff1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:14.185343 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72bbcd-291e-4fe1-b4f2-4f07c1bd7ff1 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:14.195198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 716/1402] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:14.376359 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea973e-f86f-47cc-b4fc-5b96c22968c6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:14.376650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea973e-f86f-47cc-b4fc-5b96c22968c6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:14.376928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea973e-f86f-47cc-b4fc-5b96c22968c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:14.429979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-64ea973e-f86f-47cc-b4fc-5b96c22968c6 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:14.431258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-64ea973e-f86f-47cc-b4fc-5b96c22968c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:14.496360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 687/1403] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:35:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:14.540213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607ea0d-2e86-4867-b55e-34f16b0ad703 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:14.540579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607ea0d-2e86-4867-b55e-34f16b0ad703 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:14.540922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607ea0d-2e86-4867-b55e-34f16b0ad703 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:14.542456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 717/1404] 10.222.0.79 () {54 vars in 942 bytes} [Wed May 25 14:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:14.548884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4c90-817d-4c96-a5d0-79c15736e6c0 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:14.549210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4c90-817d-4c96-a5d0-79c15736e6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:14.549490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4c90-817d-4c96-a5d0-79c15736e6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:14.599934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-bb6c4c90-817d-4c96-a5d0-79c15736e6c0 None None] MFA Rules not processed for user `fa04ddd7a6ce4bbabdfca31721b9c71d`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:14.601135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-bb6c4c90-817d-4c96-a5d0-79c15736e6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:14.638192 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:35:14.678689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 688/1405] 10.222.0.79 () {58 vars in 1039 bytes} [Wed May 25 14:35:14 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:14.688184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607ea0d-2e86-4867-b55e-34f16b0ad703 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:14.704464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607ea0d-2e86-4867-b55e-34f16b0ad703 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:14.710113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89046a38-8bea-4cb5-900c-ec4122eb4777 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:14.710857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89046a38-8bea-4cb5-900c-ec4122eb4777 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:14.711209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89046a38-8bea-4cb5-900c-ec4122eb4777 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:14.711570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89046a38-8bea-4cb5-900c-ec4122eb4777 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:14.720175 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89046a38-8bea-4cb5-900c-ec4122eb4777 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:14.721893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89046a38-8bea-4cb5-900c-ec4122eb4777 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:14.729909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 718/1406] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:35:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:35:16.484794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4dd75-cd4b-4bbd-b63a-c5feeba6c149 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:16.484794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4dd75-cd4b-4bbd-b63a-c5feeba6c149 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:16.484794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4dd75-cd4b-4bbd-b63a-c5feeba6c149 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:16.484794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 689/1407] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:16.502355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73305fce-7fd2-4375-bacd-da467a135319 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:16.502355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73305fce-7fd2-4375-bacd-da467a135319 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:16.502355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73305fce-7fd2-4375-bacd-da467a135319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:16.508072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-73305fce-7fd2-4375-bacd-da467a135319 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:16.508295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-73305fce-7fd2-4375-bacd-da467a135319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:16.519065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 719/1408] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:35:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:16.562428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4dd75-cd4b-4bbd-b63a-c5feeba6c149 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:16.579055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4dd75-cd4b-4bbd-b63a-c5feeba6c149 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:16.585050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da3602-62a9-4620-b7a6-093ec5763c85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:16.585753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da3602-62a9-4620-b7a6-093ec5763c85 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:16.586134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da3602-62a9-4620-b7a6-093ec5763c85 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:16.586423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da3602-62a9-4620-b7a6-093ec5763c85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:16.595793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da3602-62a9-4620-b7a6-093ec5763c85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:16.597436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da3602-62a9-4620-b7a6-093ec5763c85 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:16.621043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 690/1409] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:26.500963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=55 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:35:26.606916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=21 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:35:38.074414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7abe8-4bce-4681-a700-1912e1e22879 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:38.075045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7abe8-4bce-4681-a700-1912e1e22879 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:38.075045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7abe8-4bce-4681-a700-1912e1e22879 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:38.076338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 720/1410] 10.222.0.79 () {54 vars in 918 bytes} [Wed May 25 14:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:38.082029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53508e-364e-4cde-af9d-2734fde22ac3 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:38.082595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53508e-364e-4cde-af9d-2734fde22ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:38.082595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53508e-364e-4cde-af9d-2734fde22ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:38.100177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-4b53508e-364e-4cde-af9d-2734fde22ac3 None None] MFA Rules not processed for user `582296b1e43f4d12ab99eec9283b0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:38.101377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4b53508e-364e-4cde-af9d-2734fde22ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:38.110634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 691/1411] 10.222.0.79 () {58 vars in 1015 bytes} [Wed May 25 14:35:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:38.124280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b9ccd-b930-486d-94e9-9a78a04007d7 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:38.124595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b9ccd-b930-486d-94e9-9a78a04007d7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:38.124878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b9ccd-b930-486d-94e9-9a78a04007d7 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:38.126240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 721/1412] 10.222.0.79 () {54 vars in 918 bytes} [Wed May 25 14:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:38.131425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece3883-f94b-4895-ad0f-74c7d23b93d8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:38.131793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece3883-f94b-4895-ad0f-74c7d23b93d8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:38.132162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece3883-f94b-4895-ad0f-74c7d23b93d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:38.152631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7ece3883-f94b-4895-ad0f-74c7d23b93d8 None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:38.154059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7ece3883-f94b-4895-ad0f-74c7d23b93d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:38.164245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 692/1413] 10.222.0.79 () {58 vars in 1015 bytes} [Wed May 25 14:35:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:40.834221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8f64-1623-4a52-ab42-093d7dcfc7bf None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:40.834726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8f64-1623-4a52-ab42-093d7dcfc7bf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:40.834726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa8f64-1623-4a52-ab42-093d7dcfc7bf None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:40.836060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 722/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:40.841324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242e90-284f-4fa8-9238-aa6d30f99dcc None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:40.841747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242e90-284f-4fa8-9238-aa6d30f99dcc None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:40.841883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69242e90-284f-4fa8-9238-aa6d30f99dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:40.860218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-69242e90-284f-4fa8-9238-aa6d30f99dcc None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:40.861404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-69242e90-284f-4fa8-9238-aa6d30f99dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:40.869616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 693/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:40.912248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa8f64-1623-4a52-ab42-093d7dcfc7bf None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:40.927941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa8f64-1623-4a52-ab42-093d7dcfc7bf None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:40.933358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c7382-2327-4cc9-9b79-a5e5191d6c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:40.934311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7382-2327-4cc9-9b79-a5e5191d6c28 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:40.934599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7382-2327-4cc9-9b79-a5e5191d6c28 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:40.934875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7382-2327-4cc9-9b79-a5e5191d6c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:40.942897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c7382-2327-4cc9-9b79-a5e5191d6c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:40.944483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418c7382-2327-4cc9-9b79-a5e5191d6c28 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:40.954230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 723/1416] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:41.916977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d97a0b-c336-425a-a13b-e24045b71455 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:41.917515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d97a0b-c336-425a-a13b-e24045b71455 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:41.917515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d97a0b-c336-425a-a13b-e24045b71455 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:41.919725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 694/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:35:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:41.924665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189a65-9947-48f7-9d81-79be2e97a6b5 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:41.925094 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189a65-9947-48f7-9d81-79be2e97a6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:41.925296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f189a65-9947-48f7-9d81-79be2e97a6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:41.943267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5f189a65-9947-48f7-9d81-79be2e97a6b5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:41.944713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5f189a65-9947-48f7-9d81-79be2e97a6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:41.952364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 724/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:42.133123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d97a0b-c336-425a-a13b-e24045b71455 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:42.147538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d97a0b-c336-425a-a13b-e24045b71455 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:42.153002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9235cbd9-4bcf-4d7b-bc11-7876e8faa92d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:42.153659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235cbd9-4bcf-4d7b-bc11-7876e8faa92d service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:42.153961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235cbd9-4bcf-4d7b-bc11-7876e8faa92d service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:42.154260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9235cbd9-4bcf-4d7b-bc11-7876e8faa92d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:42.162122 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235cbd9-4bcf-4d7b-bc11-7876e8faa92d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:42.163703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9235cbd9-4bcf-4d7b-bc11-7876e8faa92d service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:42.172786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 695/1419] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:43.089322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f6458-b405-426b-9364-a4a98a3a46ca None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:43.089887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f6458-b405-426b-9364-a4a98a3a46ca None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:43.089887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f6458-b405-426b-9364-a4a98a3a46ca None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:43.091242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 725/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:43.096072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2052638-4373-4cb8-8635-fdbfa9973538 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:43.096507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2052638-4373-4cb8-8635-fdbfa9973538 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:43.096619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2052638-4373-4cb8-8635-fdbfa9973538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:43.114768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c2052638-4373-4cb8-8635-fdbfa9973538 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:43.115882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c2052638-4373-4cb8-8635-fdbfa9973538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:43.123601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 696/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:43.271416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f6458-b405-426b-9364-a4a98a3a46ca None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:43.286137 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f6458-b405-426b-9364-a4a98a3a46ca None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:43.291598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707c066-ac72-459a-b106-b2a460a6c6a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:43.292224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707c066-ac72-459a-b106-b2a460a6c6a2 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:43.292504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707c066-ac72-459a-b106-b2a460a6c6a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:43.292774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707c066-ac72-459a-b106-b2a460a6c6a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:43.301453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707c066-ac72-459a-b106-b2a460a6c6a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:43.303060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707c066-ac72-459a-b106-b2a460a6c6a2 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:43.312286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 726/1422] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:44.207391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf10e-327c-4bbd-9fd3-4369a4638df4 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:44.208258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf10e-327c-4bbd-9fd3-4369a4638df4 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:44.208542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdf10e-327c-4bbd-9fd3-4369a4638df4 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:44.209936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 697/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:35:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:44.214826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c402d39-e873-4b14-ad77-6d6f6b92fdcb None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:44.215253 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c402d39-e873-4b14-ad77-6d6f6b92fdcb None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:44.215424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c402d39-e873-4b14-ad77-6d6f6b92fdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:44.233508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0c402d39-e873-4b14-ad77-6d6f6b92fdcb None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:44.234724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0c402d39-e873-4b14-ad77-6d6f6b92fdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:44.243006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 727/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:44.393111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdf10e-327c-4bbd-9fd3-4369a4638df4 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:44.407716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdf10e-327c-4bbd-9fd3-4369a4638df4 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:44.413582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b4eee-69be-4eb1-9b80-44ab31e9b799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:44.414313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b4eee-69be-4eb1-9b80-44ab31e9b799 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:44.414597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b4eee-69be-4eb1-9b80-44ab31e9b799 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:44.414872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b4eee-69be-4eb1-9b80-44ab31e9b799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:44.423068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b4eee-69be-4eb1-9b80-44ab31e9b799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:44.424717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b4eee-69be-4eb1-9b80-44ab31e9b799 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:44.434144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 698/1425] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:45.339159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ec61-59ea-4df8-a352-84f5e5bcb56a None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:45.339704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ec61-59ea-4df8-a352-84f5e5bcb56a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:45.339704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ec61-59ea-4df8-a352-84f5e5bcb56a None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:45.341070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 728/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:45.346048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c0357-14b8-4e53-bdff-6e7e9a67f841 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:45.347087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c0357-14b8-4e53-bdff-6e7e9a67f841 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:45.347193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c0357-14b8-4e53-bdff-6e7e9a67f841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:45.364858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-bb2c0357-14b8-4e53-bdff-6e7e9a67f841 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:45.366056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-bb2c0357-14b8-4e53-bdff-6e7e9a67f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:45.373807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 699/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:45.524386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ec61-59ea-4df8-a352-84f5e5bcb56a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:45.538614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ec61-59ea-4df8-a352-84f5e5bcb56a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:45.544040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f312be-43da-4d85-baf0-6ccb2f6f4591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:45.544679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f312be-43da-4d85-baf0-6ccb2f6f4591 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:45.544984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f312be-43da-4d85-baf0-6ccb2f6f4591 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:45.545257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f312be-43da-4d85-baf0-6ccb2f6f4591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:45.553308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f312be-43da-4d85-baf0-6ccb2f6f4591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:45.554916 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f312be-43da-4d85-baf0-6ccb2f6f4591 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:45.564022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 729/1428] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:46.401564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f9b3b-3a0d-4399-a063-7b2e353b3376 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:46.402184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f9b3b-3a0d-4399-a063-7b2e353b3376 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:46.402184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61f9b3b-3a0d-4399-a063-7b2e353b3376 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:46.403502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 700/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:46.408357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1155d8-85a9-4b7a-88c8-a29057cc0924 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:46.409287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1155d8-85a9-4b7a-88c8-a29057cc0924 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:46.409501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1155d8-85a9-4b7a-88c8-a29057cc0924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:46.427599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1e1155d8-85a9-4b7a-88c8-a29057cc0924 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:46.428786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1e1155d8-85a9-4b7a-88c8-a29057cc0924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:46.436752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 730/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:35:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:46.586564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f9b3b-3a0d-4399-a063-7b2e353b3376 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:46.601313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61f9b3b-3a0d-4399-a063-7b2e353b3376 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:46.606759 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9ad02-b1ff-41cb-9d61-57167e444f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:46.607396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ad02-b1ff-41cb-9d61-57167e444f5c service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:46.607682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ad02-b1ff-41cb-9d61-57167e444f5c service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:46.607961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9ad02-b1ff-41cb-9d61-57167e444f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:46.616025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9ad02-b1ff-41cb-9d61-57167e444f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:46.617614 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9ad02-b1ff-41cb-9d61-57167e444f5c service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:46.626937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 701/1431] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:47.459790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3b9f5-3bfa-4188-95ad-841f909bd1e6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:47.460322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3b9f5-3bfa-4188-95ad-841f909bd1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:47.460322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e3b9f5-3bfa-4188-95ad-841f909bd1e6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:47.461726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 731/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:35:47.466558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7267-d1bc-4acc-a3f8-ba2ea0213531 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:47.467000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7267-d1bc-4acc-a3f8-ba2ea0213531 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:47.467108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7267-d1bc-4acc-a3f8-ba2ea0213531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:47.485747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-80cd7267-d1bc-4acc-a3f8-ba2ea0213531 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:47.486971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-80cd7267-d1bc-4acc-a3f8-ba2ea0213531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:47.494780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 702/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:47.642425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3b9f5-3bfa-4188-95ad-841f909bd1e6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:47.657727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e3b9f5-3bfa-4188-95ad-841f909bd1e6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:47.663553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7386ba-fef5-4524-be82-cda44561ec17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:47.664184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7386ba-fef5-4524-be82-cda44561ec17 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:47.664469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7386ba-fef5-4524-be82-cda44561ec17 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:47.664745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7386ba-fef5-4524-be82-cda44561ec17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:47.672715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7386ba-fef5-4524-be82-cda44561ec17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:47.674361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7386ba-fef5-4524-be82-cda44561ec17 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:47.683575 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 732/1434] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:48.526398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4afc77-bfe3-4a8b-b417-7dcf19e32d2f None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:48.526964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4afc77-bfe3-4a8b-b417-7dcf19e32d2f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:48.526964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4afc77-bfe3-4a8b-b417-7dcf19e32d2f None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:48.528323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 703/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:48.533322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907651ef-d459-488c-a45b-67dd1e1bb5b0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:48.534283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907651ef-d459-488c-a45b-67dd1e1bb5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:48.534447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907651ef-d459-488c-a45b-67dd1e1bb5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:48.552619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-907651ef-d459-488c-a45b-67dd1e1bb5b0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:48.553800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-907651ef-d459-488c-a45b-67dd1e1bb5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:48.561542 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 733/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:48.710612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4afc77-bfe3-4a8b-b417-7dcf19e32d2f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:48.724840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4afc77-bfe3-4a8b-b417-7dcf19e32d2f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:48.730279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf60daa-90ea-453c-b656-2800284fb21f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:48.730914 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf60daa-90ea-453c-b656-2800284fb21f service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:48.731200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf60daa-90ea-453c-b656-2800284fb21f service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:48.731479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf60daa-90ea-453c-b656-2800284fb21f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:48.739536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf60daa-90ea-453c-b656-2800284fb21f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:48.741119 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf60daa-90ea-453c-b656-2800284fb21f service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:48.750350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 704/1437] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:49.596158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab75426-3d53-4cde-89b6-67455b6138e2 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:49.597160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab75426-3d53-4cde-89b6-67455b6138e2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:49.597273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab75426-3d53-4cde-89b6-67455b6138e2 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:49.598672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 734/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:35:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:49.603525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328670b0-1d68-4496-abbb-9345f404869e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:49.603910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328670b0-1d68-4496-abbb-9345f404869e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:49.604081 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328670b0-1d68-4496-abbb-9345f404869e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:49.621605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-328670b0-1d68-4496-abbb-9345f404869e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:49.622825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-328670b0-1d68-4496-abbb-9345f404869e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:49.630565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 705/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:49.778273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab75426-3d53-4cde-89b6-67455b6138e2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:49.793151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab75426-3d53-4cde-89b6-67455b6138e2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:49.798490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba7872-427a-44bd-878a-837e6fdd3207 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:49.799122 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba7872-427a-44bd-878a-837e6fdd3207 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:49.799407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba7872-427a-44bd-878a-837e6fdd3207 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:49.799687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba7872-427a-44bd-878a-837e6fdd3207 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:49.807752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba7872-427a-44bd-878a-837e6fdd3207 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:49.809333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba7872-427a-44bd-878a-837e6fdd3207 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:49.818634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 735/1440] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:51.887330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f477-c6f2-4d83-8c40-57155aa75c45 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:51.887754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f477-c6f2-4d83-8c40-57155aa75c45 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:51.887890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a331f477-c6f2-4d83-8c40-57155aa75c45 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:51.889309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 706/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:51.895229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b943489-999b-4672-acc5-fe6a81bc54cf None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:51.895631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b943489-999b-4672-acc5-fe6a81bc54cf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:51.895784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b943489-999b-4672-acc5-fe6a81bc54cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:51.913519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4b943489-999b-4672-acc5-fe6a81bc54cf None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:51.914730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4b943489-999b-4672-acc5-fe6a81bc54cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:51.922606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 736/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:51.960959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331f477-c6f2-4d83-8c40-57155aa75c45 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:51.971963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a331f477-c6f2-4d83-8c40-57155aa75c45 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:51.975462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17c168-2f2d-4116-8acd-6b447e29b953 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:51.976084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c168-2f2d-4116-8acd-6b447e29b953 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:51.976361 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c168-2f2d-4116-8acd-6b447e29b953 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:51.976631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c168-2f2d-4116-8acd-6b447e29b953 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:51.985192 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17c168-2f2d-4116-8acd-6b447e29b953 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:51.986662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17c168-2f2d-4116-8acd-6b447e29b953 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:51.995787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 707/1443] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:54.298351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bf4d0-0dc7-4bd2-86ac-5a772f6215b4 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:54.298887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bf4d0-0dc7-4bd2-86ac-5a772f6215b4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:54.298887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3bf4d0-0dc7-4bd2-86ac-5a772f6215b4 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:54.300761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 737/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:54.305929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0dff8-32be-4e89-904f-e4abdf731052 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:54.306391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0dff8-32be-4e89-904f-e4abdf731052 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:54.306528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0dff8-32be-4e89-904f-e4abdf731052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:54.324484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-f5a0dff8-32be-4e89-904f-e4abdf731052 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:54.325680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f5a0dff8-32be-4e89-904f-e4abdf731052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:54.333436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 708/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:54.370235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bf4d0-0dc7-4bd2-86ac-5a772f6215b4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:54.381413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3bf4d0-0dc7-4bd2-86ac-5a772f6215b4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:54.385172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f0ead-1e79-4ddc-81da-e044f3f03ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:54.385801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f0ead-1e79-4ddc-81da-e044f3f03ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:54.386103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f0ead-1e79-4ddc-81da-e044f3f03ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:54.386391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f0ead-1e79-4ddc-81da-e044f3f03ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:54.395320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f0ead-1e79-4ddc-81da-e044f3f03ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:54.396750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f0ead-1e79-4ddc-81da-e044f3f03ce9 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:54.406560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 738/1446] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:56.925123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba404f0-ebd7-4aaa-8c34-bc3fa152a0fd None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:56.925601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba404f0-ebd7-4aaa-8c34-bc3fa152a0fd None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:56.925725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba404f0-ebd7-4aaa-8c34-bc3fa152a0fd None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:56.927132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 709/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:56.932470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d482-8b1b-4dc5-9dd2-b2370064860e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:56.932865 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d482-8b1b-4dc5-9dd2-b2370064860e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:56.933030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f6d482-8b1b-4dc5-9dd2-b2370064860e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:56.951275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-13f6d482-8b1b-4dc5-9dd2-b2370064860e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:56.952467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-13f6d482-8b1b-4dc5-9dd2-b2370064860e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:56.960207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 739/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:56.998716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba404f0-ebd7-4aaa-8c34-bc3fa152a0fd None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:57.009819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba404f0-ebd7-4aaa-8c34-bc3fa152a0fd None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:57.013332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8016b6-1a2c-4d9a-baf6-8a04942b3ff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:57.013964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8016b6-1a2c-4d9a-baf6-8a04942b3ff9 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:57.014290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8016b6-1a2c-4d9a-baf6-8a04942b3ff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:57.014567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8016b6-1a2c-4d9a-baf6-8a04942b3ff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:57.023297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8016b6-1a2c-4d9a-baf6-8a04942b3ff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:57.024727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8016b6-1a2c-4d9a-baf6-8a04942b3ff9 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:57.034401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 710/1449] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:35:59.330666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526396f-3c14-493d-95dc-6fed0f5685d1 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:59.331231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526396f-3c14-493d-95dc-6fed0f5685d1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:59.331231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526396f-3c14-493d-95dc-6fed0f5685d1 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:59.332552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 740/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:35:59.337689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fa9b4-33a5-49da-a757-e01b90efb161 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:59.338162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fa9b4-33a5-49da-a757-e01b90efb161 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:59.338270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674fa9b4-33a5-49da-a757-e01b90efb161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:59.356536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-674fa9b4-33a5-49da-a757-e01b90efb161 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:35:59.357741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-674fa9b4-33a5-49da-a757-e01b90efb161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:35:59.366066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 711/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:35:59.403593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526396f-3c14-493d-95dc-6fed0f5685d1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:35:59.414230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526396f-3c14-493d-95dc-6fed0f5685d1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:35:59.417739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793581a-3e9b-4a5c-b0b4-5d2c19d083b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:35:59.418428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793581a-3e9b-4a5c-b0b4-5d2c19d083b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:35:59.418708 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793581a-3e9b-4a5c-b0b4-5d2c19d083b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:35:59.418978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793581a-3e9b-4a5c-b0b4-5d2c19d083b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:35:59.428481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793581a-3e9b-4a5c-b0b4-5d2c19d083b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:35:59.429900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793581a-3e9b-4a5c-b0b4-5d2c19d083b5 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:35:59.439100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 741/1452] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:35:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:01.677644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91d24-346b-4708-a74a-e175200a8bc1 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:01.678221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91d24-346b-4708-a74a-e175200a8bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:01.678221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb91d24-346b-4708-a74a-e175200a8bc1 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:01.679608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 712/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:01.684793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39695ed8-079b-4950-84c3-31dd84c8571f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:01.685237 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39695ed8-079b-4950-84c3-31dd84c8571f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:01.685383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39695ed8-079b-4950-84c3-31dd84c8571f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:01.703551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-39695ed8-079b-4950-84c3-31dd84c8571f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:01.704738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-39695ed8-079b-4950-84c3-31dd84c8571f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:01.712540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 742/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:36:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:01.749540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb91d24-346b-4708-a74a-e175200a8bc1 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:01.760992 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb91d24-346b-4708-a74a-e175200a8bc1 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:01.764419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2653b61-acf6-4d79-9e8a-10035913b70c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:01.765048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653b61-acf6-4d79-9e8a-10035913b70c service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:01.765324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653b61-acf6-4d79-9e8a-10035913b70c service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:01.765593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2653b61-acf6-4d79-9e8a-10035913b70c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:01.774204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2653b61-acf6-4d79-9e8a-10035913b70c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:01.775620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2653b61-acf6-4d79-9e8a-10035913b70c service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:01.784830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 713/1455] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:03.999737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5240d-7f97-4e7b-b5e2-fcbfd70a987c None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:04.000289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5240d-7f97-4e7b-b5e2-fcbfd70a987c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:04.000289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5240d-7f97-4e7b-b5e2-fcbfd70a987c None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:04.001690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 743/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:04.007410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a06aa-cbee-4678-95cd-c30a0928b59a None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:04.007810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a06aa-cbee-4678-95cd-c30a0928b59a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:04.007956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a06aa-cbee-4678-95cd-c30a0928b59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:04.025519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-202a06aa-cbee-4678-95cd-c30a0928b59a None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:04.026726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-202a06aa-cbee-4678-95cd-c30a0928b59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:04.034300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 714/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:36:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:04.071595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5240d-7f97-4e7b-b5e2-fcbfd70a987c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:04.082277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5240d-7f97-4e7b-b5e2-fcbfd70a987c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:04.085760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb01f3-ef22-459e-8510-d6e105152510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:04.086427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb01f3-ef22-459e-8510-d6e105152510 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:04.086712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb01f3-ef22-459e-8510-d6e105152510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:04.086987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb01f3-ef22-459e-8510-d6e105152510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:04.095708 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb01f3-ef22-459e-8510-d6e105152510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:04.097153 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb01f3-ef22-459e-8510-d6e105152510 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:04.106406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 744/1458] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:06.341968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f12655-b7fe-4842-9200-6ebcb037d357 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:06.342536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f12655-b7fe-4842-9200-6ebcb037d357 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:06.342536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f12655-b7fe-4842-9200-6ebcb037d357 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:06.343954 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 715/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:06.349986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7eb7-ce1b-46dd-a4ba-e2f7cf97d20e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:06.350412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7eb7-ce1b-46dd-a4ba-e2f7cf97d20e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:06.350572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7eb7-ce1b-46dd-a4ba-e2f7cf97d20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:06.367977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-946f7eb7-ce1b-46dd-a4ba-e2f7cf97d20e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:06.369170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-946f7eb7-ce1b-46dd-a4ba-e2f7cf97d20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:06.376941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 745/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:06.414382 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f12655-b7fe-4842-9200-6ebcb037d357 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:06.425015 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f12655-b7fe-4842-9200-6ebcb037d357 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:06.428523 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881bfdc-4c0a-48c0-82d5-21628225bde9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:06.429151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881bfdc-4c0a-48c0-82d5-21628225bde9 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:06.429435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881bfdc-4c0a-48c0-82d5-21628225bde9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:06.429712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881bfdc-4c0a-48c0-82d5-21628225bde9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:06.438499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881bfdc-4c0a-48c0-82d5-21628225bde9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:06.440422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881bfdc-4c0a-48c0-82d5-21628225bde9 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:06.449866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 716/1461] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:08.705606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d48fd-e1f1-4561-8282-ec0f323cc895 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:08.706194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d48fd-e1f1-4561-8282-ec0f323cc895 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:08.706194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d48fd-e1f1-4561-8282-ec0f323cc895 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:08.707541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 746/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:08.713089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e88f6-3752-4257-9033-f60b76f57be6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:08.713483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e88f6-3752-4257-9033-f60b76f57be6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:08.713678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e88f6-3752-4257-9033-f60b76f57be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:08.719684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=79 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:36:08.732804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-570e88f6-3752-4257-9033-f60b76f57be6 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:08.734219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-570e88f6-3752-4257-9033-f60b76f57be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:08.742475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 717/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:08.780597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d48fd-e1f1-4561-8282-ec0f323cc895 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:08.782314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-986d48fd-e1f1-4561-8282-ec0f323cc895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:08.789915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=73 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:36:08.796332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d48fd-e1f1-4561-8282-ec0f323cc895 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:08.800009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663f239e-cb58-416b-99e8-26d8496fe64d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:08.800643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f239e-cb58-416b-99e8-26d8496fe64d service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:08.800955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f239e-cb58-416b-99e8-26d8496fe64d service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:08.801231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663f239e-cb58-416b-99e8-26d8496fe64d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:08.810219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f239e-cb58-416b-99e8-26d8496fe64d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:08.811670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663f239e-cb58-416b-99e8-26d8496fe64d service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:08.821461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 747/1464] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:11.067563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d51fc-1b40-4798-9e92-fc600fdb1013 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:11.068115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d51fc-1b40-4798-9e92-fc600fdb1013 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:11.068115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d51fc-1b40-4798-9e92-fc600fdb1013 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:11.069509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 718/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:11.074843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1a20a-8d60-441b-af20-180ff7fd51d3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:11.075270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1a20a-8d60-441b-af20-180ff7fd51d3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:11.075400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1a20a-8d60-441b-af20-180ff7fd51d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:11.093599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-83f1a20a-8d60-441b-af20-180ff7fd51d3 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:11.094846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-83f1a20a-8d60-441b-af20-180ff7fd51d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:11.102519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 748/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:11.138547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d51fc-1b40-4798-9e92-fc600fdb1013 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:11.149510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d51fc-1b40-4798-9e92-fc600fdb1013 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:11.153009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bef5aeb-e2ed-45eb-85d8-b5727434a36c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:11.153640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5aeb-e2ed-45eb-85d8-b5727434a36c service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:11.153924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5aeb-e2ed-45eb-85d8-b5727434a36c service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:11.154243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bef5aeb-e2ed-45eb-85d8-b5727434a36c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:11.163179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef5aeb-e2ed-45eb-85d8-b5727434a36c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:11.164607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bef5aeb-e2ed-45eb-85d8-b5727434a36c service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:11.173797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 719/1467] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:13.360498 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599654-1c6a-43e3-a65d-74a48b61324d None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:13.361065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599654-1c6a-43e3-a65d-74a48b61324d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:13.361193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7599654-1c6a-43e3-a65d-74a48b61324d None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:13.362490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 749/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:13.367685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3dc57-3d47-4112-af42-7078ef56590e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:13.368126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3dc57-3d47-4112-af42-7078ef56590e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:13.368237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3dc57-3d47-4112-af42-7078ef56590e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:13.387238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c6a3dc57-3d47-4112-af42-7078ef56590e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:13.388416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c6a3dc57-3d47-4112-af42-7078ef56590e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:13.396642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 720/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:13.432313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7599654-1c6a-43e3-a65d-74a48b61324d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:13.443290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7599654-1c6a-43e3-a65d-74a48b61324d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:13.446731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cddd4ae-8577-4abb-9c6d-0fab15fed8a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:13.447353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd4ae-8577-4abb-9c6d-0fab15fed8a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:13.447631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd4ae-8577-4abb-9c6d-0fab15fed8a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:13.447901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cddd4ae-8577-4abb-9c6d-0fab15fed8a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:13.456612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddd4ae-8577-4abb-9c6d-0fab15fed8a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:13.458027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cddd4ae-8577-4abb-9c6d-0fab15fed8a6 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:13.467149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 750/1470] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:23.381251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=11 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:36:23.463071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=14 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:36:46.376856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601c40-fc20-429b-ae22-d78ebfd4a266 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:46.377469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601c40-fc20-429b-ae22-d78ebfd4a266 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:46.377469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba601c40-fc20-429b-ae22-d78ebfd4a266 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:46.378825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 721/1471] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:46.384332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d82561-48ca-4364-9d1c-571599514d89 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:46.384731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d82561-48ca-4364-9d1c-571599514d89 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:46.384895 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d82561-48ca-4364-9d1c-571599514d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:46.402357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b7d82561-48ca-4364-9d1c-571599514d89 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:46.403545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b7d82561-48ca-4364-9d1c-571599514d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:46.411336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 751/1472] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:46.457411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f4cb-ce37-47a5-81e2-0e0eda6b80bb None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:46.457701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f4cb-ce37-47a5-81e2-0e0eda6b80bb None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:46.457982 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a604f4cb-ce37-47a5-81e2-0e0eda6b80bb None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:46.459368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 722/1473] 10.222.0.79 () {54 vars in 962 bytes} [Wed May 25 14:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:46.464078 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62a64-670a-494e-bca7-438c3b91e211 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:46.464365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62a64-670a-494e-bca7-438c3b91e211 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:46.464642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb62a64-670a-494e-bca7-438c3b91e211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:46.482210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-efb62a64-670a-494e-bca7-438c3b91e211 None None] MFA Rules not processed for user `0edbf66359f1426999f4c28a83f2bdca`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:46.483679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-efb62a64-670a-494e-bca7-438c3b91e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:46.490555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 752/1474] 10.222.0.79 () {58 vars in 1059 bytes} [Wed May 25 14:36:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:46.497499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f4cb-ce37-47a5-81e2-0e0eda6b80bb None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:46.508352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a604f4cb-ce37-47a5-81e2-0e0eda6b80bb None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:46.512053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb1f4b-9ef2-4203-85f9-cef043c608db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0edbf66359f1426999f4c28a83f2bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:46.512664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb1f4b-9ef2-4203-85f9-cef043c608db service glance] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:46.512942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb1f4b-9ef2-4203-85f9-cef043c608db service glance] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:46.513215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb1f4b-9ef2-4203-85f9-cef043c608db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:46.522321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb1f4b-9ef2-4203-85f9-cef043c608db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:46.523815 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb1f4b-9ef2-4203-85f9-cef043c608db service glance] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:46.533118 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 723/1475] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:48.814370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b788-1c36-4e79-9842-a8ebc4217cff None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:48.814932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b788-1c36-4e79-9842-a8ebc4217cff None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:48.814932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1834b788-1c36-4e79-9842-a8ebc4217cff None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:48.816287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 753/1476] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:48.821421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b55663-0890-4f26-9b9d-9ed20337d288 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:48.821842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b55663-0890-4f26-9b9d-9ed20337d288 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:48.821990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b55663-0890-4f26-9b9d-9ed20337d288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:48.839335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d8b55663-0890-4f26-9b9d-9ed20337d288 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:48.840536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d8b55663-0890-4f26-9b9d-9ed20337d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:48.848897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 724/1477] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:48.872907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834b788-1c36-4e79-9842-a8ebc4217cff None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:48.885496 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1834b788-1c36-4e79-9842-a8ebc4217cff None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:48.889910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6ffac-e4eb-4ab7-9194-d969e9369896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:48.890584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ffac-e4eb-4ab7-9194-d969e9369896 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:48.890867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ffac-e4eb-4ab7-9194-d969e9369896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:48.891140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6ffac-e4eb-4ab7-9194-d969e9369896 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:48.891866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6ffac-e4eb-4ab7-9194-d969e9369896 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:48.893643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-f9a6ffac-e4eb-4ab7-9194-d969e9369896 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:36:48.893643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:36:48.893643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: May 25 14:36:48.894797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6ffac-e4eb-4ab7-9194-d969e9369896 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:48.914988 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 754/1478] 10.222.0.79 () {56 vars in 1108 bytes} [Wed May 25 14:36:48 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:36:51.098297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12217a5-157d-437d-9bdd-cea2ba298bd1 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:51.098848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12217a5-157d-437d-9bdd-cea2ba298bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:51.098848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12217a5-157d-437d-9bdd-cea2ba298bd1 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:51.100205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 725/1479] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:51.105277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5998-cf43-4867-8572-7ec737465d8d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:51.105744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5998-cf43-4867-8572-7ec737465d8d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:51.105855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba5998-cf43-4867-8572-7ec737465d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:51.123985 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-37ba5998-cf43-4867-8572-7ec737465d8d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:51.125172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-37ba5998-cf43-4867-8572-7ec737465d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:51.132911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 755/1480] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:51.175792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12217a5-157d-437d-9bdd-cea2ba298bd1 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:51.189947 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12217a5-157d-437d-9bdd-cea2ba298bd1 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:51.195237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67dd728-e6c5-4d9c-9179-b27bdcfc3d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:51.195868 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dd728-e6c5-4d9c-9179-b27bdcfc3d42 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:51.196174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dd728-e6c5-4d9c-9179-b27bdcfc3d42 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:51.196449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67dd728-e6c5-4d9c-9179-b27bdcfc3d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:51.204319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67dd728-e6c5-4d9c-9179-b27bdcfc3d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:51.205894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67dd728-e6c5-4d9c-9179-b27bdcfc3d42 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:51.215041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 726/1481] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:53.597737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5aa76-9f83-40d1-b8b8-6152bec87627 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:53.598271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5aa76-9f83-40d1-b8b8-6152bec87627 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:53.598271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5aa76-9f83-40d1-b8b8-6152bec87627 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:53.599678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 756/1482] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:53.604896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087c75-f5f8-470b-af65-023e3e11fa56 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:53.605326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087c75-f5f8-470b-af65-023e3e11fa56 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:53.605459 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb087c75-f5f8-470b-af65-023e3e11fa56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:53.622845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-fb087c75-f5f8-470b-af65-023e3e11fa56 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:53.624044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fb087c75-f5f8-470b-af65-023e3e11fa56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:53.632296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 727/1483] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:53.669440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5aa76-9f83-40d1-b8b8-6152bec87627 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:53.680066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5aa76-9f83-40d1-b8b8-6152bec87627 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:53.683518 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34218b5-7586-497e-b1b1-a66b531902ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:53.684142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34218b5-7586-497e-b1b1-a66b531902ae service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:53.684426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34218b5-7586-497e-b1b1-a66b531902ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:53.684703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34218b5-7586-497e-b1b1-a66b531902ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:53.694880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34218b5-7586-497e-b1b1-a66b531902ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:53.696359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34218b5-7586-497e-b1b1-a66b531902ae service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:53.707404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 757/1484] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:55.954267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f83b0-1be5-4f42-a44b-fcf22e01c63d None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:55.954822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f83b0-1be5-4f42-a44b-fcf22e01c63d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:55.954926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392f83b0-1be5-4f42-a44b-fcf22e01c63d None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:55.956231 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 728/1485] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:55.961695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430631-23ce-4fec-8c2a-0fbfcf245675 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:55.962239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430631-23ce-4fec-8c2a-0fbfcf245675 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:55.962340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68430631-23ce-4fec-8c2a-0fbfcf245675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:55.979742 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-68430631-23ce-4fec-8c2a-0fbfcf245675 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:55.980920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-68430631-23ce-4fec-8c2a-0fbfcf245675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:55.989928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 758/1486] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:56.028011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f83b0-1be5-4f42-a44b-fcf22e01c63d None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:56.038653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392f83b0-1be5-4f42-a44b-fcf22e01c63d None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:56.042209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829e5c5-4c27-4b7a-9fc0-5068b50fedf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:56.042844 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829e5c5-4c27-4b7a-9fc0-5068b50fedf9 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:56.043132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829e5c5-4c27-4b7a-9fc0-5068b50fedf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:56.043406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829e5c5-4c27-4b7a-9fc0-5068b50fedf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:56.052786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829e5c5-4c27-4b7a-9fc0-5068b50fedf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:56.054262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829e5c5-4c27-4b7a-9fc0-5068b50fedf9 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:56.064191 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 729/1487] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:36:58.540038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66117a3a-1220-4fd7-8d3c-5344350869c5 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:58.540578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66117a3a-1220-4fd7-8d3c-5344350869c5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:58.540578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66117a3a-1220-4fd7-8d3c-5344350869c5 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:58.541943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 759/1488] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:36:58.547814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1bab4-4bf2-4511-b79b-9f24654734ad None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:58.548228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1bab4-4bf2-4511-b79b-9f24654734ad None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:58.548368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1bab4-4bf2-4511-b79b-9f24654734ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:58.566372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-96a1bab4-4bf2-4511-b79b-9f24654734ad None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:36:58.567576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-96a1bab4-4bf2-4511-b79b-9f24654734ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:36:58.575320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 730/1489] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:36:58.615598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66117a3a-1220-4fd7-8d3c-5344350869c5 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:36:58.626196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66117a3a-1220-4fd7-8d3c-5344350869c5 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:36:58.629709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da38e0-39a6-4b51-bd40-c27314c7fd8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:36:58.630378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da38e0-39a6-4b51-bd40-c27314c7fd8c service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:36:58.630662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da38e0-39a6-4b51-bd40-c27314c7fd8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:36:58.630941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da38e0-39a6-4b51-bd40-c27314c7fd8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:36:58.640424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da38e0-39a6-4b51-bd40-c27314c7fd8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:36:58.641983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da38e0-39a6-4b51-bd40-c27314c7fd8c service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:36:58.651505 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 760/1490] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:37:01.060266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4f3c-7abc-476c-937f-630e48b0d318 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:01.060850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4f3c-7abc-476c-937f-630e48b0d318 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:01.060850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4f3c-7abc-476c-937f-630e48b0d318 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:01.062892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 731/1491] 10.222.0.79 () {54 vars in 926 bytes} [Wed May 25 14:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:37:01.068107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb2483-3e3a-41fe-a5dd-678489c7bdba None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:01.068512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb2483-3e3a-41fe-a5dd-678489c7bdba None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:01.068663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb2483-3e3a-41fe-a5dd-678489c7bdba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:01.086545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c5fb2483-3e3a-41fe-a5dd-678489c7bdba None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:37:01.087736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c5fb2483-3e3a-41fe-a5dd-678489c7bdba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:37:01.095482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 761/1492] 10.222.0.79 () {58 vars in 1023 bytes} [Wed May 25 14:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:37:01.133111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4f3c-7abc-476c-937f-630e48b0d318 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:37:01.144413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4f3c-7abc-476c-937f-630e48b0d318 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:37:01.148065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69557205-02f1-4eef-937a-2308718d55f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:37:01.148694 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557205-02f1-4eef-937a-2308718d55f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:37:01.148983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557205-02f1-4eef-937a-2308718d55f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:37:01.149257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69557205-02f1-4eef-937a-2308718d55f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:37:01.158070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69557205-02f1-4eef-937a-2308718d55f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:37:01.159525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69557205-02f1-4eef-937a-2308718d55f3 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:37:01.168725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 732/1493] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:37:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:37:11.081489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=33 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:37:11.164581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=33 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:40.156376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbcd3b-124c-43be-8fdb-6724d431bfeb None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.156950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbcd3b-124c-43be-8fdb-6724d431bfeb None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.156950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbcd3b-124c-43be-8fdb-6724d431bfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.177063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-96dbcd3b-124c-43be-8fdb-6724d431bfeb None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:40.178626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-96dbcd3b-124c-43be-8fdb-6724d431bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:40.187475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 762/1494] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:38:40.196625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5f53-e902-4eb1-a315-92f3bc580df7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.197126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5f53-e902-4eb1-a315-92f3bc580df7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.197231 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf5f53-e902-4eb1-a315-92f3bc580df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.216019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-70cf5f53-e902-4eb1-a315-92f3bc580df7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:40.217216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-70cf5f53-e902-4eb1-a315-92f3bc580df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:40.224997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 733/1495] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:38:40.229555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbcd3b-124c-43be-8fdb-6724d431bfeb None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:40.239456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbcd3b-124c-43be-8fdb-6724d431bfeb None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:40.243906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bc959-0bbe-4395-81d4-efbed764e516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:40.244552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bc959-0bbe-4395-81d4-efbed764e516 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.244832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bc959-0bbe-4395-81d4-efbed764e516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.245105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bc959-0bbe-4395-81d4-efbed764e516 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.245871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bc959-0bbe-4395-81d4-efbed764e516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:38:40.246208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bc959-0bbe-4395-81d4-efbed764e516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:40.247233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-3d3bc959-0bbe-4395-81d4-efbed764e516 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:38:40.247233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:38:40.247233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: May 25 14:38:40.248125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bc959-0bbe-4395-81d4-efbed764e516 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:40.259962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 763/1496] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:38:40.269031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf5f53-e902-4eb1-a315-92f3bc580df7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:40.278077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf5f53-e902-4eb1-a315-92f3bc580df7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:40.282657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784ea39-2a2c-47a4-9508-f3f178767095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:40.283305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784ea39-2a2c-47a4-9508-f3f178767095 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.283591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784ea39-2a2c-47a4-9508-f3f178767095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.283871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784ea39-2a2c-47a4-9508-f3f178767095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.284572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784ea39-2a2c-47a4-9508-f3f178767095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:40.286399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: WARNING py.warnings [None req-7784ea39-2a2c-47a4-9508-f3f178767095 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:38:40.286399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: warnings.warn(msg) May 25 14:38:40.286399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: May 25 14:38:40.287592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784ea39-2a2c-47a4-9508-f3f178767095 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:40.334607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 734/1497] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:38:40 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:38:40.339126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bc959-0bbe-4395-81d4-efbed764e516 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:40.349047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bc959-0bbe-4395-81d4-efbed764e516 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:40.404525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e0e8c-4902-4cfd-a8d7-a5d8da13a491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:40.405197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e0e8c-4902-4cfd-a8d7-a5d8da13a491 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.405481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e0e8c-4902-4cfd-a8d7-a5d8da13a491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.405757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e0e8c-4902-4cfd-a8d7-a5d8da13a491 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.406529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e0e8c-4902-4cfd-a8d7-a5d8da13a491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:40.407504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-535e0e8c-4902-4cfd-a8d7-a5d8da13a491 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:38:40.407504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:38:40.407504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: May 25 14:38:40.408718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e0e8c-4902-4cfd-a8d7-a5d8da13a491 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:40.430207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 764/1498] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:38:40 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:38:40.434821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784ea39-2a2c-47a4-9508-f3f178767095 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:40.445911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784ea39-2a2c-47a4-9508-f3f178767095 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:40.451098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936a6c3-5514-46c7-a34d-b654d621dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:40.451762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936a6c3-5514-46c7-a34d-b654d621dc08 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.452045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936a6c3-5514-46c7-a34d-b654d621dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.452320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936a6c3-5514-46c7-a34d-b654d621dc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.453077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936a6c3-5514-46c7-a34d-b654d621dc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:40.454104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: WARNING py.warnings [None req-f936a6c3-5514-46c7-a34d-b654d621dc08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:38:40.454104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: warnings.warn(msg) May 25 14:38:40.454104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: May 25 14:38:40.454997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936a6c3-5514-46c7-a34d-b654d621dc08 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:40.468092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 735/1499] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:38:40.472113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e0e8c-4902-4cfd-a8d7-a5d8da13a491 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:40.482524 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e0e8c-4902-4cfd-a8d7-a5d8da13a491 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:40.487144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23402871-bbfd-4c49-bc04-215bf905fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:40.487794 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23402871-bbfd-4c49-bc04-215bf905fff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.488077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23402871-bbfd-4c49-bc04-215bf905fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.488352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23402871-bbfd-4c49-bc04-215bf905fff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.489064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23402871-bbfd-4c49-bc04-215bf905fff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:40.490100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-23402871-bbfd-4c49-bc04-215bf905fff9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:38:40.490100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:38:40.490100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: May 25 14:38:40.491007 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23402871-bbfd-4c49-bc04-215bf905fff9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:40.505569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 765/1500] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:38:40.509812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936a6c3-5514-46c7-a34d-b654d621dc08 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:40.520977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936a6c3-5514-46c7-a34d-b654d621dc08 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:40.526236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c23c66-fcb8-4f41-b5de-e8d04920c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:40.527155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c23c66-fcb8-4f41-b5de-e8d04920c96a admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.527434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c23c66-fcb8-4f41-b5de-e8d04920c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.527709 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c23c66-fcb8-4f41-b5de-e8d04920c96a admin admin] PATH_INFO: `/v3/projects/9dcd5ee860d24253a8f1727eeb1afa6e/users/1042306f3ebd4a799ef2129db9640b43/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.542316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c23c66-fcb8-4f41-b5de-e8d04920c96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dcd5ee860d24253a8f1727eeb1afa6e, user_id=1042306f3ebd4a799ef2129db9640b43, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:40.543859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: WARNING py.warnings [None req-80c23c66-fcb8-4f41-b5de-e8d04920c96a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:38:40.543859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: warnings.warn(msg) May 25 14:38:40.543859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: May 25 14:38:40.545764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c23c66-fcb8-4f41-b5de-e8d04920c96a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:40.558973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 736/1501] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:38:40 2022] PUT /identity/v3/projects/9dcd5ee860d24253a8f1727eeb1afa6e/users/1042306f3ebd4a799ef2129db9640b43/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:38:40.571043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8adfd-aaca-43e5-913e-3644ba5e4223 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.571333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8adfd-aaca-43e5-913e-3644ba5e4223 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.571614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8adfd-aaca-43e5-913e-3644ba5e4223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.598765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2fd8adfd-aaca-43e5-913e-3644ba5e4223 None None] MFA Rules not processed for user `1042306f3ebd4a799ef2129db9640b43`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:40.600029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2fd8adfd-aaca-43e5-913e-3644ba5e4223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:40.662912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 766/1502] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:38:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:38:40.676405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997eaa-0bdb-4ed2-a173-53721b2b3316 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.676702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997eaa-0bdb-4ed2-a173-53721b2b3316 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.676984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee997eaa-0bdb-4ed2-a173-53721b2b3316 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.678395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 737/1503] 10.222.0.79 () {54 vars in 963 bytes} [Wed May 25 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:40.683143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333e7d4-6f5c-400b-9655-51a910b8b088 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.683437 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333e7d4-6f5c-400b-9655-51a910b8b088 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.683724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333e7d4-6f5c-400b-9655-51a910b8b088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.701321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f333e7d4-6f5c-400b-9655-51a910b8b088 None None] MFA Rules not processed for user `eacbb2c50c2c464db93b6cff7a10f7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:40.702562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f333e7d4-6f5c-400b-9655-51a910b8b088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:40.745325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:40.754432 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 767/1504] 10.222.0.79 () {58 vars in 1060 bytes} [Wed May 25 14:38:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:38:40.864595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997eaa-0bdb-4ed2-a173-53721b2b3316 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:40.875708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee997eaa-0bdb-4ed2-a173-53721b2b3316 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:40.879227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b611-6bc5-4d6f-b7f8-3e1b47f5ca27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:40.879856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b611-6bc5-4d6f-b7f8-3e1b47f5ca27 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.880140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b611-6bc5-4d6f-b7f8-3e1b47f5ca27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.880417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b519b611-6bc5-4d6f-b7f8-3e1b47f5ca27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.889087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519b611-6bc5-4d6f-b7f8-3e1b47f5ca27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:40.890545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b519b611-6bc5-4d6f-b7f8-3e1b47f5ca27 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:40.899664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 738/1505] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:38:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:38:40.940553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289beaa-e7c5-48e6-8e26-e1f4c7be72f4 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:40.940842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289beaa-e7c5-48e6-8e26-e1f4c7be72f4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:40.941119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289beaa-e7c5-48e6-8e26-e1f4c7be72f4 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:40.942416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 768/1506] 10.222.0.79 () {52 vars in 829 bytes} [Wed May 25 14:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:38:40.945926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b611-6bc5-4d6f-b7f8-3e1b47f5ca27 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:41.007815 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b519b611-6bc5-4d6f-b7f8-3e1b47f5ca27 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:41.012590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:41.013460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.013744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.014024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] PATH_INFO: `/v3/users/1042306f3ebd4a799ef2129db9640b43` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.015238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1042306f3ebd4a799ef2129db9640b43)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:41.016256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: WARNING py.warnings [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:38:41.016256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: warnings.warn(msg) May 25 14:38:41.016256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: May 25 14:38:41.017456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:41.082423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1042306f3ebd4a799ef2129db9640b43'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:38:41.083056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1042306f3ebd4a799ef2129db9640b43'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:38:41.083760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1042306f3ebd4a799ef2129db9640b43'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:38:41.101370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1042306f3ebd4a799ef2129db9640b43'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:38:41.113752 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1042306f3ebd4a799ef2129db9640b43'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:38:41.118076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:41.132096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 739/1507] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:38:40 2022] DELETE /identity/v3/users/1042306f3ebd4a799ef2129db9640b43 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:38:41.136787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d8017-ac40-4d6a-9fb8-86e85c7b21a1 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.137077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d8017-ac40-4d6a-9fb8-86e85c7b21a1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.137354 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d8017-ac40-4d6a-9fb8-86e85c7b21a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.154395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ba5d8017-ac40-4d6a-9fb8-86e85c7b21a1 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:38:41.155589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ba5d8017-ac40-4d6a-9fb8-86e85c7b21a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:41.213150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 769/1508] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:38:41.222489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:41.223886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:41.283525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e36460-8e84-46a0-ab5c-e166c8410b88 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:41.287064 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a80991-1330-4be2-b6ce-06498be55e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:41.287697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a80991-1330-4be2-b6ce-06498be55e8e service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.287977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a80991-1330-4be2-b6ce-06498be55e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.288252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a80991-1330-4be2-b6ce-06498be55e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.297548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a80991-1330-4be2-b6ce-06498be55e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:41.298997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a80991-1330-4be2-b6ce-06498be55e8e service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:41.308182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 740/1509] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:38:41.631028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d8017-ac40-4d6a-9fb8-86e85c7b21a1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:38:41.632466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ba5d8017-ac40-4d6a-9fb8-86e85c7b21a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:38:41.644559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5d8017-ac40-4d6a-9fb8-86e85c7b21a1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:38:41.649217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:38:41.649989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:38:41.650322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:38:41.650603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] PATH_INFO: `/v3/projects/9dcd5ee860d24253a8f1727eeb1afa6e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:38:41.652297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dcd5ee860d24253a8f1727eeb1afa6e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:38:41.653336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:38:41.653336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:38:41.653336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: May 25 14:38:41.654584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:38:41.714659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dcd5ee860d24253a8f1727eeb1afa6e', 'request_id': 'req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:38:41.723289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dcd5ee860d24253a8f1727eeb1afa6e', 'request_id': 'req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:38:41.736936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dcd5ee860d24253a8f1727eeb1afa6e', 'request_id': 'req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:38:41.748222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] The token cache is being invalidate because project 9dcd5ee860d24253a8f1727eeb1afa6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:38:41.748510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:38:41.749157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5326a84b-0953-4e82-9dfc-55bc9fbf9f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:38:41.750843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 770/1510] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:38:41 2022] DELETE /identity/v3/projects/9dcd5ee860d24253a8f1727eeb1afa6e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:38:51.304070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:38:51.744522 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:40:35.344091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2c121-1ba0-4e22-9057-f3e384daa6a3 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:35.344710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2c121-1ba0-4e22-9057-f3e384daa6a3 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:35.344710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e2c121-1ba0-4e22-9057-f3e384daa6a3 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:35.346015 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 741/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:35.350779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126732-53b4-4c9e-8ed1-16cbf14f8162 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:35.351759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126732-53b4-4c9e-8ed1-16cbf14f8162 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:35.351919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8126732-53b4-4c9e-8ed1-16cbf14f8162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:35.369713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c8126732-53b4-4c9e-8ed1-16cbf14f8162 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:35.370937 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c8126732-53b4-4c9e-8ed1-16cbf14f8162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:35.428921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 771/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:40:35.594433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2c121-1ba0-4e22-9057-f3e384daa6a3 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:35.596089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-24e2c121-1ba0-4e22-9057-f3e384daa6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:35.669082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e2c121-1ba0-4e22-9057-f3e384daa6a3 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:35.674430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a587d6d-468a-49e1-a82e-dfacef5d6efa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:35.675069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a587d6d-468a-49e1-a82e-dfacef5d6efa service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:35.675351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a587d6d-468a-49e1-a82e-dfacef5d6efa service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:35.675630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a587d6d-468a-49e1-a82e-dfacef5d6efa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:35.683825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a587d6d-468a-49e1-a82e-dfacef5d6efa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:35.685450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a587d6d-468a-49e1-a82e-dfacef5d6efa service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:35.695329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 742/1513] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:40:36.408704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6823644-1727-4273-8d38-5b088005e4bd None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:36.409285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6823644-1727-4273-8d38-5b088005e4bd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:36.409391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6823644-1727-4273-8d38-5b088005e4bd None None] PATH_INFO: `/v3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:36.410696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 772/1514] 10.222.0.81 () {54 vars in 925 bytes} [Wed May 25 14:40:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:40:36.418014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac01a0-3ec3-4809-9d87-59e6c4f4778a None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:36.418491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac01a0-3ec3-4809-9d87-59e6c4f4778a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:36.418593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac01a0-3ec3-4809-9d87-59e6c4f4778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:36.437240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1aac01a0-3ec3-4809-9d87-59e6c4f4778a None None] MFA Rules not processed for user `582296b1e43f4d12ab99eec9283b0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:36.438460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1aac01a0-3ec3-4809-9d87-59e6c4f4778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:36.499943 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 743/1515] 10.222.0.81 () {58 vars in 1015 bytes} [Wed May 25 14:40:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:40:36.566393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c124f-819a-4241-8602-4e5d375815b5 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:36.566677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c124f-819a-4241-8602-4e5d375815b5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:36.566954 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7c124f-819a-4241-8602-4e5d375815b5 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:36.568364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 773/1516] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:36.573115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db470fe-aa78-47e9-8cb6-0828c0a574c0 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:36.573411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db470fe-aa78-47e9-8cb6-0828c0a574c0 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:36.573691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db470fe-aa78-47e9-8cb6-0828c0a574c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:36.591402 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-5db470fe-aa78-47e9-8cb6-0828c0a574c0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:36.592580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5db470fe-aa78-47e9-8cb6-0828c0a574c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:36.600206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 744/1517] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:40:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:40:36.750907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c124f-819a-4241-8602-4e5d375815b5 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:36.765038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7c124f-819a-4241-8602-4e5d375815b5 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:36.770367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4b1739-8b4b-4c78-b162-d86a305020de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:36.770993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1739-8b4b-4c78-b162-d86a305020de service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:36.771270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1739-8b4b-4c78-b162-d86a305020de service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:36.771541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b1739-8b4b-4c78-b162-d86a305020de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:36.780276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b1739-8b4b-4c78-b162-d86a305020de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:36.781881 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4b1739-8b4b-4c78-b162-d86a305020de service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:36.791758 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 774/1518] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:40:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:40:45.434134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1ecd-b600-4cba-85f0-c5ada03f7eaa None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:45.434594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1ecd-b600-4cba-85f0-c5ada03f7eaa None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:45.434696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4d1ecd-b600-4cba-85f0-c5ada03f7eaa None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:45.436063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 745/1519] 10.222.0.79 () {54 vars in 960 bytes} [Wed May 25 14:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:45.441021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62f7b-73c3-48d7-983e-308926c316cd None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:45.441447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62f7b-73c3-48d7-983e-308926c316cd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:45.441555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c62f7b-73c3-48d7-983e-308926c316cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:45.460842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-23c62f7b-73c3-48d7-983e-308926c316cd None None] MFA Rules not processed for user `582296b1e43f4d12ab99eec9283b0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:45.462039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-23c62f7b-73c3-48d7-983e-308926c316cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:45.470431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 775/1520] 10.222.0.79 () {58 vars in 1057 bytes} [Wed May 25 14:40:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:40:45.478225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d1ecd-b600-4cba-85f0-c5ada03f7eaa None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:45.491782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4d1ecd-b600-4cba-85f0-c5ada03f7eaa None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:45.496590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe3c3b-69ae-4295-963c-3739c0acb8b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582296b1e43f4d12ab99eec9283b0d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:45.497207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe3c3b-69ae-4295-963c-3739c0acb8b0 service placement] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:45.497487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe3c3b-69ae-4295-963c-3739c0acb8b0 service placement] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:45.497758 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe3c3b-69ae-4295-963c-3739c0acb8b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:45.505966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe3c3b-69ae-4295-963c-3739c0acb8b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:45.507906 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe3c3b-69ae-4295-963c-3739c0acb8b0 service placement] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:45.517588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 746/1521] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:40:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:40:48.066774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da6581-4f71-4a9e-9910-c715a46acad2 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:48.067315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da6581-4f71-4a9e-9910-c715a46acad2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:48.067315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da6581-4f71-4a9e-9910-c715a46acad2 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:48.068690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 776/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:40:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:48.073464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796997bd-3bda-4ead-82af-3e989edc64b7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:48.073902 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796997bd-3bda-4ead-82af-3e989edc64b7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:48.074007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796997bd-3bda-4ead-82af-3e989edc64b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:48.092062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-796997bd-3bda-4ead-82af-3e989edc64b7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:48.093244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-796997bd-3bda-4ead-82af-3e989edc64b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:48.101550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 747/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:40:48.250967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da6581-4f71-4a9e-9910-c715a46acad2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:48.265932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da6581-4f71-4a9e-9910-c715a46acad2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:48.271471 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77815c39-e853-4f44-ab8e-b784447ebee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:48.272680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815c39-e853-4f44-ab8e-b784447ebee2 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:48.272887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815c39-e853-4f44-ab8e-b784447ebee2 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:48.273157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815c39-e853-4f44-ab8e-b784447ebee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:48.281327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77815c39-e853-4f44-ab8e-b784447ebee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:48.282946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77815c39-e853-4f44-ab8e-b784447ebee2 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:48.292887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 777/1524] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:40:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:40:49.164904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3fb3b-ced0-4576-b4c8-3bda788956a7 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:49.165481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3fb3b-ced0-4576-b4c8-3bda788956a7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:49.165481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3fb3b-ced0-4576-b4c8-3bda788956a7 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:49.166849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 748/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 14:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:40:49.171427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519cfbb-85a1-49f2-a170-a442ec475968 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:49.171822 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519cfbb-85a1-49f2-a170-a442ec475968 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:49.171996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519cfbb-85a1-49f2-a170-a442ec475968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:49.190029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0519cfbb-85a1-49f2-a170-a442ec475968 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:49.191246 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0519cfbb-85a1-49f2-a170-a442ec475968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:49.199485 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 778/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 14:40:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:40:49.346893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3fb3b-ced0-4576-b4c8-3bda788956a7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:49.361624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3fb3b-ced0-4576-b4c8-3bda788956a7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:49.367592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd6211-8870-49c1-ba56-e150f040f355 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:49.368226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6211-8870-49c1-ba56-e150f040f355 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:49.368511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6211-8870-49c1-ba56-e150f040f355 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:49.368793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd6211-8870-49c1-ba56-e150f040f355 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:49.377012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd6211-8870-49c1-ba56-e150f040f355 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:49.378661 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd6211-8870-49c1-ba56-e150f040f355 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:49.388085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 749/1527] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:40:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:40:53.638528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfacf6-8dec-4ca1-8935-1fd31b5094b2 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:53.639094 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfacf6-8dec-4ca1-8935-1fd31b5094b2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:53.639094 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfacf6-8dec-4ca1-8935-1fd31b5094b2 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:53.640435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 779/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:53.645805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedf390-e903-45c6-b467-0febfb8624c0 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:53.646272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedf390-e903-45c6-b467-0febfb8624c0 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:53.646383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aedf390-e903-45c6-b467-0febfb8624c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:53.664799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-3aedf390-e903-45c6-b467-0febfb8624c0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:53.665979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3aedf390-e903-45c6-b467-0febfb8624c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:53.673781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 750/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:40:53.711178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfacf6-8dec-4ca1-8935-1fd31b5094b2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:53.712936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8dcfacf6-8dec-4ca1-8935-1fd31b5094b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:53.771037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfacf6-8dec-4ca1-8935-1fd31b5094b2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:53.775187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797dae-2d4a-4cf3-9083-5d264f0dfe0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:53.775829 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797dae-2d4a-4cf3-9083-5d264f0dfe0c service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:53.776116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797dae-2d4a-4cf3-9083-5d264f0dfe0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:53.776397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797dae-2d4a-4cf3-9083-5d264f0dfe0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:53.785347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b797dae-2d4a-4cf3-9083-5d264f0dfe0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:53.786828 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b797dae-2d4a-4cf3-9083-5d264f0dfe0c service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:53.796181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 780/1530] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:40:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:40:55.951911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affac1bd-445b-4872-b690-a475f8504d5d None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:55.952420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affac1bd-445b-4872-b690-a475f8504d5d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:55.952547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affac1bd-445b-4872-b690-a475f8504d5d None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:55.953824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 751/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:40:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:55.958987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27470-5784-4261-81a6-e1000265c084 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:55.959398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27470-5784-4261-81a6-e1000265c084 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:55.959548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae27470-5784-4261-81a6-e1000265c084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:55.978270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1ae27470-5784-4261-81a6-e1000265c084 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:55.979480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1ae27470-5784-4261-81a6-e1000265c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:55.987299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 781/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:40:56.023107 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affac1bd-445b-4872-b690-a475f8504d5d None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:40:56.033778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affac1bd-445b-4872-b690-a475f8504d5d None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:40:56.037325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3563603-3efd-410f-9678-66c597f69063 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:40:56.038495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3563603-3efd-410f-9678-66c597f69063 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:56.038777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3563603-3efd-410f-9678-66c597f69063 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:56.039056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3563603-3efd-410f-9678-66c597f69063 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:56.048116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3563603-3efd-410f-9678-66c597f69063 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:40:56.049538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3563603-3efd-410f-9678-66c597f69063 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:40:56.059494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 752/1533] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:40:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:40:59.765316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4fd75-56e5-4cda-931f-19c0155f64cf None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:59.765909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4fd75-56e5-4cda-931f-19c0155f64cf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:59.765909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4fd75-56e5-4cda-931f-19c0155f64cf None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:59.767258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 782/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:40:59.772448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac7324-e445-43f5-9c67-134f1b7c63e4 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:40:59.772851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac7324-e445-43f5-9c67-134f1b7c63e4 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:40:59.772995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac7324-e445-43f5-9c67-134f1b7c63e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:40:59.791102 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-13ac7324-e445-43f5-9c67-134f1b7c63e4 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:40:59.792283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-13ac7324-e445-43f5-9c67-134f1b7c63e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:40:59.799892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 753/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:00.066901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4fd75-56e5-4cda-931f-19c0155f64cf None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:00.068601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5bf4fd75-56e5-4cda-931f-19c0155f64cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:00.127073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4fd75-56e5-4cda-931f-19c0155f64cf None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:00.130943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76af8cb-fb5d-41d3-81de-1e19509593ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:00.133071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76af8cb-fb5d-41d3-81de-1e19509593ba service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:00.133071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76af8cb-fb5d-41d3-81de-1e19509593ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:00.133071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76af8cb-fb5d-41d3-81de-1e19509593ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:00.142646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76af8cb-fb5d-41d3-81de-1e19509593ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:00.144199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76af8cb-fb5d-41d3-81de-1e19509593ba service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:00.149478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:00.155124 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 783/1536] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:02.360401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeb334-cc5a-4ed0-a1a7-fb6efb2cd2e3 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:02.360978 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeb334-cc5a-4ed0-a1a7-fb6efb2cd2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:02.360978 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eeb334-cc5a-4ed0-a1a7-fb6efb2cd2e3 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:02.362420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 754/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 14:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:41:02.368170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e024de-6c74-4377-975f-749eb632e4fc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:02.368595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e024de-6c74-4377-975f-749eb632e4fc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:02.368765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e024de-6c74-4377-975f-749eb632e4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:02.387412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-36e024de-6c74-4377-975f-749eb632e4fc None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:41:02.388608 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-36e024de-6c74-4377-975f-749eb632e4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:02.396449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 784/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 14:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:41:02.664096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeb334-cc5a-4ed0-a1a7-fb6efb2cd2e3 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:41:02.665772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-51eeb334-cc5a-4ed0-a1a7-fb6efb2cd2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:41:02.673239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=94 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:02.680182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eeb334-cc5a-4ed0-a1a7-fb6efb2cd2e3 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:41:02.683720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a964c-2a15-4651-b683-9c14bf5dbb25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:41:02.684355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a964c-2a15-4651-b683-9c14bf5dbb25 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:41:02.684638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a964c-2a15-4651-b683-9c14bf5dbb25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:41:02.684915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a964c-2a15-4651-b683-9c14bf5dbb25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:41:02.693701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a964c-2a15-4651-b683-9c14bf5dbb25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:41:02.695174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a964c-2a15-4651-b683-9c14bf5dbb25 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:41:02.704409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 755/1539] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:41:12.381361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:41:12.700236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:38.216595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab60e44-a75c-43dc-bf75-88aa830085f5 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.217228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab60e44-a75c-43dc-bf75-88aa830085f5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.217228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab60e44-a75c-43dc-bf75-88aa830085f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.250525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0ab60e44-a75c-43dc-bf75-88aa830085f5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.251734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0ab60e44-a75c-43dc-bf75-88aa830085f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.256846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4ac1-6f25-43cd-b5dc-edc6818cec97 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.257669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4ac1-6f25-43cd-b5dc-edc6818cec97 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.257669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf4ac1-6f25-43cd-b5dc-edc6818cec97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.271073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 785/1540] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:38.282237 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e380-a101-45fc-9f3f-a1874c633eed None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.282585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e380-a101-45fc-9f3f-a1874c633eed None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.282790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e380-a101-45fc-9f3f-a1874c633eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.291378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-3acf4ac1-6f25-43cd-b5dc-edc6818cec97 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.292858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3acf4ac1-6f25-43cd-b5dc-edc6818cec97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.312053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 756/1541] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.314804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68821307-3485-43e6-a9ed-c163714d4e1b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.315091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68821307-3485-43e6-a9ed-c163714d4e1b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.315376 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68821307-3485-43e6-a9ed-c163714d4e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.316974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7636e380-a101-45fc-9f3f-a1874c633eed None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.318454 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7636e380-a101-45fc-9f3f-a1874c633eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.345172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 786/1542] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:38.347135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faded86-1d43-4b42-aecd-880020098e13 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.347421 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faded86-1d43-4b42-aecd-880020098e13 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.347697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faded86-1d43-4b42-aecd-880020098e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.372732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-68821307-3485-43e6-a9ed-c163714d4e1b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.372732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-68821307-3485-43e6-a9ed-c163714d4e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.384020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7faded86-1d43-4b42-aecd-880020098e13 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.385239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7faded86-1d43-4b42-aecd-880020098e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.396437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 757/1543] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:38.397538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68821307-3485-43e6-a9ed-c163714d4e1b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.404770 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 787/1544] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.407629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab25303-29d7-48cf-a66d-4cbf2791cb40 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.408097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab25303-29d7-48cf-a66d-4cbf2791cb40 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.408592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab25303-29d7-48cf-a66d-4cbf2791cb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.416869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68821307-3485-43e6-a9ed-c163714d4e1b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.435898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7135e-210e-4832-b50a-ce8cfdfbedeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.436592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7135e-210e-4832-b50a-ce8cfdfbedeb admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.436877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7135e-210e-4832-b50a-ce8cfdfbedeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.437152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7135e-210e-4832-b50a-ce8cfdfbedeb admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.437908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7135e-210e-4832-b50a-ce8cfdfbedeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:38.438243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7135e-210e-4832-b50a-ce8cfdfbedeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.439536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: WARNING py.warnings [None req-4ef7135e-210e-4832-b50a-ce8cfdfbedeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 14:42:38.439536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: warnings.warn(msg) May 25 14:42:38.439536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: May 25 14:42:38.441007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7135e-210e-4832-b50a-ce8cfdfbedeb admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.445068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2ab25303-29d7-48cf-a66d-4cbf2791cb40 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.446757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2ab25303-29d7-48cf-a66d-4cbf2791cb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.460144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 788/1545] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:38.461304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab25303-29d7-48cf-a66d-4cbf2791cb40 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.464138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 758/1546] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:38.467557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7135e-210e-4832-b50a-ce8cfdfbedeb admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.484281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7135e-210e-4832-b50a-ce8cfdfbedeb admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.489362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab25303-29d7-48cf-a66d-4cbf2791cb40 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.499028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249b8f7-a054-4908-8cc9-bb72ef1dc377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.500085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249b8f7-a054-4908-8cc9-bb72ef1dc377 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.500555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249b8f7-a054-4908-8cc9-bb72ef1dc377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.501014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249b8f7-a054-4908-8cc9-bb72ef1dc377 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.501961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249b8f7-a054-4908-8cc9-bb72ef1dc377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:38.502568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249b8f7-a054-4908-8cc9-bb72ef1dc377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.503097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a758a2-d18e-4e06-b75a-1ec48471773b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.503864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a758a2-d18e-4e06-b75a-1ec48471773b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.504220 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a758a2-d18e-4e06-b75a-1ec48471773b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.504568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a758a2-d18e-4e06-b75a-1ec48471773b admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.505376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a758a2-d18e-4e06-b75a-1ec48471773b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:38.505691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a758a2-d18e-4e06-b75a-1ec48471773b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.506161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249b8f7-a054-4908-8cc9-bb72ef1dc377 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.515876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a758a2-d18e-4e06-b75a-1ec48471773b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.523357 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 759/1547] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:38.526490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e13fca-1603-4604-b8b4-0afc6a654c44 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.527055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e13fca-1603-4604-b8b4-0afc6a654c44 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.527557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e13fca-1603-4604-b8b4-0afc6a654c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.538440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 789/1548] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:38.539618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a758a2-d18e-4e06-b75a-1ec48471773b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.553049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-71e13fca-1603-4604-b8b4-0afc6a654c44 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.553049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-71e13fca-1603-4604-b8b4-0afc6a654c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.559021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a758a2-d18e-4e06-b75a-1ec48471773b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.560796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 760/1549] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.566132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5a48b-5f3e-44a0-8471-3e2eb07462e8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.566132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5a48b-5f3e-44a0-8471-3e2eb07462e8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.566132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5a48b-5f3e-44a0-8471-3e2eb07462e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.571160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce7c25-8630-48ce-ac5e-5ae42f6b00a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.571909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce7c25-8630-48ce-ac5e-5ae42f6b00a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.572262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce7c25-8630-48ce-ac5e-5ae42f6b00a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.572604 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce7c25-8630-48ce-ac5e-5ae42f6b00a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.573515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce7c25-8630-48ce-ac5e-5ae42f6b00a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.574655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-3bce7c25-8630-48ce-ac5e-5ae42f6b00a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:42:38.574655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:42:38.574655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: May 25 14:42:38.575972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce7c25-8630-48ce-ac5e-5ae42f6b00a7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.585367 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d3b5a48b-5f3e-44a0-8471-3e2eb07462e8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.586631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d3b5a48b-5f3e-44a0-8471-3e2eb07462e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.595748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 761/1550] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.601206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c182-ab9c-4a0d-a25c-c83f05942472 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.601629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c182-ab9c-4a0d-a25c-c83f05942472 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.601909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684c182-ab9c-4a0d-a25c-c83f05942472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.606284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 790/1551] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:38.607146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce7c25-8630-48ce-ac5e-5ae42f6b00a7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.633385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-0684c182-ab9c-4a0d-a25c-c83f05942472 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.634629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0684c182-ab9c-4a0d-a25c-c83f05942472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.680103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce7c25-8630-48ce-ac5e-5ae42f6b00a7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.685022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3453df-ccd6-411a-88b3-c0cd6cb0c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.685698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3453df-ccd6-411a-88b3-c0cd6cb0c389 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.685983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3453df-ccd6-411a-88b3-c0cd6cb0c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.686295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3453df-ccd6-411a-88b3-c0cd6cb0c389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.686999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3453df-ccd6-411a-88b3-c0cd6cb0c389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.688964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3453df-ccd6-411a-88b3-c0cd6cb0c389 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.698414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 762/1552] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.699275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684c182-ab9c-4a0d-a25c-c83f05942472 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.711965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0684c182-ab9c-4a0d-a25c-c83f05942472 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.717898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e72526-1d04-4731-b57e-7bf1ba9804fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.718747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72526-1d04-4731-b57e-7bf1ba9804fd admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.719172 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72526-1d04-4731-b57e-7bf1ba9804fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.719723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e72526-1d04-4731-b57e-7bf1ba9804fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.721109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e72526-1d04-4731-b57e-7bf1ba9804fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.724677 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e72526-1d04-4731-b57e-7bf1ba9804fd admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.737545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 791/1553] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:38.739642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b43350-9474-4341-835a-88c737dc5387 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.740146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b43350-9474-4341-835a-88c737dc5387 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.740635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b43350-9474-4341-835a-88c737dc5387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.763128 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-68b43350-9474-4341-835a-88c737dc5387 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.764424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-68b43350-9474-4341-835a-88c737dc5387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.771042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 763/1554] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:38.773330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2f73b-bb34-4dd2-b059-2b75cbb1b138 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.773849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2f73b-bb34-4dd2-b059-2b75cbb1b138 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.774386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2f73b-bb34-4dd2-b059-2b75cbb1b138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.798976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a8e2f73b-bb34-4dd2-b059-2b75cbb1b138 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.801166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a8e2f73b-bb34-4dd2-b059-2b75cbb1b138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.834001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 792/1555] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.834904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b43350-9474-4341-835a-88c737dc5387 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.846155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b43350-9474-4341-835a-88c737dc5387 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.869891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:38.872439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 764/1556] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.873883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1019c9-e590-4b0e-b929-53f2362f70de None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.874650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1019c9-e590-4b0e-b929-53f2362f70de None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.874650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1019c9-e590-4b0e-b929-53f2362f70de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.894357 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-6d1019c9-e590-4b0e-b929-53f2362f70de None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.895564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6d1019c9-e590-4b0e-b929-53f2362f70de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.909365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 765/1557] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.909365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665627c-5bec-424e-9d6f-8d605770a7a2 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.909365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665627c-5bec-424e-9d6f-8d605770a7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.909365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0665627c-5bec-424e-9d6f-8d605770a7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.916162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c3d7a-3ee2-4487-bdcc-f2922c94ee66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.916846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3d7a-3ee2-4487-bdcc-f2922c94ee66 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.917132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3d7a-3ee2-4487-bdcc-f2922c94ee66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.917412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937c3d7a-3ee2-4487-bdcc-f2922c94ee66 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.918273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c3d7a-3ee2-4487-bdcc-f2922c94ee66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.920242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937c3d7a-3ee2-4487-bdcc-f2922c94ee66 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.924859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-0665627c-5bec-424e-9d6f-8d605770a7a2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.926105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0665627c-5bec-424e-9d6f-8d605770a7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.934317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 766/1558] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.935582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824a114-02b8-4ca8-8793-27ca2d598c98 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.935876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824a114-02b8-4ca8-8793-27ca2d598c98 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.936165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0824a114-02b8-4ca8-8793-27ca2d598c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.945296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 793/1559] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:38.946117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c3d7a-3ee2-4487-bdcc-f2922c94ee66 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.958116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937c3d7a-3ee2-4487-bdcc-f2922c94ee66 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:38.963609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9354e-b7c7-45b4-87c0-25a3dd2f0d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:38.964677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9354e-b7c7-45b4-87c0-25a3dd2f0d7d admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:38.965349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-0824a114-02b8-4ca8-8793-27ca2d598c98 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:38.965468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9354e-b7c7-45b4-87c0-25a3dd2f0d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:38.965666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9354e-b7c7-45b4-87c0-25a3dd2f0d7d admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:38.967116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9354e-b7c7-45b4-87c0-25a3dd2f0d7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:38.967858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0824a114-02b8-4ca8-8793-27ca2d598c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:38.970752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e9354e-b7c7-45b4-87c0-25a3dd2f0d7d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:38.980208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 767/1560] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:38.981512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824a114-02b8-4ca8-8793-27ca2d598c98 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:38.996419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0824a114-02b8-4ca8-8793-27ca2d598c98 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.002108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa51bef-f716-4b08-8ab7-5fa6a88b0581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.003307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa51bef-f716-4b08-8ab7-5fa6a88b0581 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.003591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa51bef-f716-4b08-8ab7-5fa6a88b0581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.009394 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 794/1561] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:39.009627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa51bef-f716-4b08-8ab7-5fa6a88b0581 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.009627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa51bef-f716-4b08-8ab7-5fa6a88b0581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.009627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: WARNING py.warnings [None req-4aa51bef-f716-4b08-8ab7-5fa6a88b0581 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:42:39.009627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: warnings.warn(msg) May 25 14:42:39.009627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: May 25 14:42:39.010029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435a14d-e2d3-4e5a-8687-11aa20b10b9d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.010029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435a14d-e2d3-4e5a-8687-11aa20b10b9d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.010245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa51bef-f716-4b08-8ab7-5fa6a88b0581 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.010322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435a14d-e2d3-4e5a-8687-11aa20b10b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.016071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.038647 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 768/1562] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:38 2022] POST /identity/v3/users => generated 286 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:39.038873 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f435a14d-e2d3-4e5a-8687-11aa20b10b9d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:39.038988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa51bef-f716-4b08-8ab7-5fa6a88b0581 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.039070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f435a14d-e2d3-4e5a-8687-11aa20b10b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.050068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa51bef-f716-4b08-8ab7-5fa6a88b0581 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.053221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 795/1563] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:39.053885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435a14d-e2d3-4e5a-8687-11aa20b10b9d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.059066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da341617-94df-4d78-8b7d-7042f3d9ece7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.059944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da341617-94df-4d78-8b7d-7042f3d9ece7 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.060335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da341617-94df-4d78-8b7d-7042f3d9ece7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.060756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da341617-94df-4d78-8b7d-7042f3d9ece7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.061706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da341617-94df-4d78-8b7d-7042f3d9ece7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:39.062248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da341617-94df-4d78-8b7d-7042f3d9ece7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.064081 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da341617-94df-4d78-8b7d-7042f3d9ece7 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.067027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435a14d-e2d3-4e5a-8687-11aa20b10b9d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.072374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96afe3-51e5-4a1b-a9bb-0170cc65444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.073217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96afe3-51e5-4a1b-a9bb-0170cc65444d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.073596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96afe3-51e5-4a1b-a9bb-0170cc65444d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.073998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96afe3-51e5-4a1b-a9bb-0170cc65444d admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.075117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96afe3-51e5-4a1b-a9bb-0170cc65444d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:39.075525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96afe3-51e5-4a1b-a9bb-0170cc65444d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.077260 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96afe3-51e5-4a1b-a9bb-0170cc65444d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.089171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 769/1564] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:39.091587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb1a74-b52e-4660-895c-606d8abfc627 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.093182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb1a74-b52e-4660-895c-606d8abfc627 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.093182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb1a74-b52e-4660-895c-606d8abfc627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.098454 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 796/1565] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:39.100316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96afe3-51e5-4a1b-a9bb-0170cc65444d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.114107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96afe3-51e5-4a1b-a9bb-0170cc65444d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.118625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-90eb1a74-b52e-4660-895c-606d8abfc627 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:39.119323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212ed06-c313-4b21-9d29-670ec25fa4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.119984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-90eb1a74-b52e-4660-895c-606d8abfc627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:39.120169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ed06-c313-4b21-9d29-670ec25fa4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.120545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ed06-c313-4b21-9d29-670ec25fa4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.120893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212ed06-c313-4b21-9d29-670ec25fa4b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.121754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212ed06-c313-4b21-9d29-670ec25fa4b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.123526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c212ed06-c313-4b21-9d29-670ec25fa4b7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.128576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 770/1566] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:39.129536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb1a74-b52e-4660-895c-606d8abfc627 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.139801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 797/1567] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:39.139801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212ed06-c313-4b21-9d29-670ec25fa4b7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.144324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb1a74-b52e-4660-895c-606d8abfc627 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.151378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212ed06-c313-4b21-9d29-670ec25fa4b7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.151767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581988ca-f9ca-4e3e-9727-80cf201e58c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.152898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581988ca-f9ca-4e3e-9727-80cf201e58c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.153556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581988ca-f9ca-4e3e-9727-80cf201e58c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.154115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581988ca-f9ca-4e3e-9727-80cf201e58c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.155498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581988ca-f9ca-4e3e-9727-80cf201e58c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:39.155950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444791d8-09c0-443b-9b80-2d024dda959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.156108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581988ca-f9ca-4e3e-9727-80cf201e58c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.156620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444791d8-09c0-443b-9b80-2d024dda959c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.157059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444791d8-09c0-443b-9b80-2d024dda959c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.157346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444791d8-09c0-443b-9b80-2d024dda959c admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.158103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444791d8-09c0-443b-9b80-2d024dda959c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.159361 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581988ca-f9ca-4e3e-9727-80cf201e58c9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.160334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444791d8-09c0-443b-9b80-2d024dda959c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.171649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 798/1568] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:39.172665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 771/1569] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:39.172817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444791d8-09c0-443b-9b80-2d024dda959c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.173267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581988ca-f9ca-4e3e-9727-80cf201e58c9 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.183652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581988ca-f9ca-4e3e-9727-80cf201e58c9 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.188609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444791d8-09c0-443b-9b80-2d024dda959c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.190976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9207e7-df9e-44ac-a706-f7649930db50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.191643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9207e7-df9e-44ac-a706-f7649930db50 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.191924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9207e7-df9e-44ac-a706-f7649930db50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.192218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9207e7-df9e-44ac-a706-f7649930db50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.192939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9207e7-df9e-44ac-a706-f7649930db50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:39.193221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9207e7-df9e-44ac-a706-f7649930db50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.194438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee301cc-b04b-40d6-9a7c-82dbcfad0bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.194988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9207e7-df9e-44ac-a706-f7649930db50 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.195501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee301cc-b04b-40d6-9a7c-82dbcfad0bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.195864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee301cc-b04b-40d6-9a7c-82dbcfad0bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.196221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee301cc-b04b-40d6-9a7c-82dbcfad0bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.197265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee301cc-b04b-40d6-9a7c-82dbcfad0bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.199119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee301cc-b04b-40d6-9a7c-82dbcfad0bc6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.210044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 772/1570] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:39.210044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9207e7-df9e-44ac-a706-f7649930db50 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.217026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 799/1571] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:39.217026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee301cc-b04b-40d6-9a7c-82dbcfad0bc6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.226832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9207e7-df9e-44ac-a706-f7649930db50 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.229263 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee301cc-b04b-40d6-9a7c-82dbcfad0bc6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.232481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8d234-f3f6-44c3-a0ea-9138c8227b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.233872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d234-f3f6-44c3-a0ea-9138c8227b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.234335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d234-f3f6-44c3-a0ea-9138c8227b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.234761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8d234-f3f6-44c3-a0ea-9138c8227b0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.235536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8d234-f3f6-44c3-a0ea-9138c8227b0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.235935 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80631b1-bc0e-4ffc-b53a-30282e2e3cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.237399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80631b1-bc0e-4ffc-b53a-30282e2e3cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.237399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80631b1-bc0e-4ffc-b53a-30282e2e3cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.237658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8d234-f3f6-44c3-a0ea-9138c8227b0d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.237798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80631b1-bc0e-4ffc-b53a-30282e2e3cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.238699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80631b1-bc0e-4ffc-b53a-30282e2e3cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.241747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80631b1-bc0e-4ffc-b53a-30282e2e3cc2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.270381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 773/1572] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:39.271764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8d234-f3f6-44c3-a0ea-9138c8227b0d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.279594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 800/1573] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/projects => generated 389 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:39.280776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80631b1-bc0e-4ffc-b53a-30282e2e3cc2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.350860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80631b1-bc0e-4ffc-b53a-30282e2e3cc2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.351764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8d234-f3f6-44c3-a0ea-9138c8227b0d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.355835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ae706-8342-4b3a-aea4-38f800887fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.358193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae706-8342-4b3a-aea4-38f800887fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.358193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae706-8342-4b3a-aea4-38f800887fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.358193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ae706-8342-4b3a-aea4-38f800887fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.358193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ae706-8342-4b3a-aea4-38f800887fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.359441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24486752-750a-4cb4-9483-8aab1ffdd52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.359441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486752-750a-4cb4-9483-8aab1ffdd52c admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.359441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486752-750a-4cb4-9483-8aab1ffdd52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.359441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486752-750a-4cb4-9483-8aab1ffdd52c admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.359918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ae706-8342-4b3a-aea4-38f800887fe9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.360272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24486752-750a-4cb4-9483-8aab1ffdd52c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:39.360615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24486752-750a-4cb4-9483-8aab1ffdd52c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.362870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24486752-750a-4cb4-9483-8aab1ffdd52c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.375276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 801/1574] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:39.375276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ae706-8342-4b3a-aea4-38f800887fe9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.379802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 774/1575] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:39.380668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24486752-750a-4cb4-9483-8aab1ffdd52c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.386239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ae706-8342-4b3a-aea4-38f800887fe9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.391018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb534d8e-2a10-4b08-b365-790c2f9b852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.391676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb534d8e-2a10-4b08-b365-790c2f9b852f admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.391958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb534d8e-2a10-4b08-b365-790c2f9b852f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.392228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb534d8e-2a10-4b08-b365-790c2f9b852f admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.393476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb534d8e-2a10-4b08-b365-790c2f9b852f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.395426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb534d8e-2a10-4b08-b365-790c2f9b852f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.399207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24486752-750a-4cb4-9483-8aab1ffdd52c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.410829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2490c-1546-4240-9daa-4cfd8b5f9f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.411570 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2490c-1546-4240-9daa-4cfd8b5f9f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.411859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2490c-1546-4240-9daa-4cfd8b5f9f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.412279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2490c-1546-4240-9daa-4cfd8b5f9f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.414237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2490c-1546-4240-9daa-4cfd8b5f9f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.415800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2490c-1546-4240-9daa-4cfd8b5f9f9d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.415948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.426764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 775/1576] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:39.427601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2490c-1546-4240-9daa-4cfd8b5f9f9d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.432606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 802/1577] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:39.432606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb534d8e-2a10-4b08-b365-790c2f9b852f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.438406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2490c-1546-4240-9daa-4cfd8b5f9f9d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.499026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb534d8e-2a10-4b08-b365-790c2f9b852f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.504480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d505-acba-48e2-b9ee-206511826b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.505152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d505-acba-48e2-b9ee-206511826b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.505438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d505-acba-48e2-b9ee-206511826b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.505714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d724d505-acba-48e2-b9ee-206511826b70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.506488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724d505-acba-48e2-b9ee-206511826b70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.508433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d724d505-acba-48e2-b9ee-206511826b70 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.512429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adbdbd-3ea9-4f35-bd9f-12f274ea8072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.513291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adbdbd-3ea9-4f35-bd9f-12f274ea8072 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.513600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adbdbd-3ea9-4f35-bd9f-12f274ea8072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.514270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34adbdbd-3ea9-4f35-bd9f-12f274ea8072 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.514971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adbdbd-3ea9-4f35-bd9f-12f274ea8072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.517304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34adbdbd-3ea9-4f35-bd9f-12f274ea8072 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.521710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 803/1578] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:39.523906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d505-acba-48e2-b9ee-206511826b70 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.527375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.537490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d724d505-acba-48e2-b9ee-206511826b70 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.542825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9eec8-2399-4cfc-bb9a-593bfa378d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.543913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9eec8-2399-4cfc-bb9a-593bfa378d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.543913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9eec8-2399-4cfc-bb9a-593bfa378d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.544125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9eec8-2399-4cfc-bb9a-593bfa378d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.544743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9eec8-2399-4cfc-bb9a-593bfa378d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.546913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9eec8-2399-4cfc-bb9a-593bfa378d6a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.552314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 776/1579] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/projects => generated 371 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:39.552314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adbdbd-3ea9-4f35-bd9f-12f274ea8072 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.572181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 804/1580] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/users => generated 292 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:39.573589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9eec8-2399-4cfc-bb9a-593bfa378d6a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.586964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9eec8-2399-4cfc-bb9a-593bfa378d6a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.638308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34adbdbd-3ea9-4f35-bd9f-12f274ea8072 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.644557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4c94-d15e-4699-9341-e50ab85b47cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.644962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4c94-d15e-4699-9341-e50ab85b47cc admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.645249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4c94-d15e-4699-9341-e50ab85b47cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.645529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce4c94-d15e-4699-9341-e50ab85b47cc admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.646273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce4c94-d15e-4699-9341-e50ab85b47cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.648246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce4c94-d15e-4699-9341-e50ab85b47cc admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.658922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da89ff-9499-49d9-a3b9-ff39136c3d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.659560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da89ff-9499-49d9-a3b9-ff39136c3d5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.659725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da89ff-9499-49d9-a3b9-ff39136c3d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.660148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da89ff-9499-49d9-a3b9-ff39136c3d5b admin admin] PATH_INFO: `/v3/projects/e61e8f31edc94a3ea6c23b3fd0aac04a/users/1102bd74633c42b6be5f419c16ba89cb/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.674580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 777/1581] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:39.676771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da89ff-9499-49d9-a3b9-ff39136c3d5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e61e8f31edc94a3ea6c23b3fd0aac04a, user_id=1102bd74633c42b6be5f419c16ba89cb, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.677849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-c4da89ff-9499-49d9-a3b9-ff39136c3d5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:42:39.677849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:42:39.677849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: May 25 14:42:39.678520 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4c94-d15e-4699-9341-e50ab85b47cc admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.679949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da89ff-9499-49d9-a3b9-ff39136c3d5b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.690980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce4c94-d15e-4699-9341-e50ab85b47cc admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.696352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 805/1582] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:39 2022] PUT /identity/v3/projects/e61e8f31edc94a3ea6c23b3fd0aac04a/users/1102bd74633c42b6be5f419c16ba89cb/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:39.700620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da89ff-9499-49d9-a3b9-ff39136c3d5b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.761326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e0ef0-e626-4600-b913-97155d9cfe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.762166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e0ef0-e626-4600-b913-97155d9cfe21 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.762501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e0ef0-e626-4600-b913-97155d9cfe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.762782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e0ef0-e626-4600-b913-97155d9cfe21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.763492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e0ef0-e626-4600-b913-97155d9cfe21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.765444 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65e0ef0-e626-4600-b913-97155d9cfe21 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.766174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.771488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da89ff-9499-49d9-a3b9-ff39136c3d5b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.779993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b510e-205b-4d23-8a17-ee1b2b7c7dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.781037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b510e-205b-4d23-8a17-ee1b2b7c7dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.781319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b510e-205b-4d23-8a17-ee1b2b7c7dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.781636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b510e-205b-4d23-8a17-ee1b2b7c7dc7 admin admin] PATH_INFO: `/v3/projects/91398ee1dddc4d97bc909b562cf8e763/users/e26fe8b541484066a2b7c35cd20a4132/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.802949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b510e-205b-4d23-8a17-ee1b2b7c7dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91398ee1dddc4d97bc909b562cf8e763, user_id=e26fe8b541484066a2b7c35cd20a4132, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.809035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b510e-205b-4d23-8a17-ee1b2b7c7dc7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.815495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 778/1583] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/projects => generated 405 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:39.816817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e0ef0-e626-4600-b913-97155d9cfe21 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.838538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 806/1584] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:39 2022] PUT /identity/v3/projects/91398ee1dddc4d97bc909b562cf8e763/users/e26fe8b541484066a2b7c35cd20a4132/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:39.839658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b510e-205b-4d23-8a17-ee1b2b7c7dc7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:39.920076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65e0ef0-e626-4600-b913-97155d9cfe21 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.933307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:39.937139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b510e-205b-4d23-8a17-ee1b2b7c7dc7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:39.943678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f8c5f-e18d-4694-96fd-3ae783d383e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:39.944637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f8c5f-e18d-4694-96fd-3ae783d383e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:39.944917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f8c5f-e18d-4694-96fd-3ae783d383e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:39.945221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f8c5f-e18d-4694-96fd-3ae783d383e9 admin admin] PATH_INFO: `/v3/projects/f437557f8d5840c0824980a63e11ce94/users/b19de893206941b3b5c975e035fb604b/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:39.967265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f8c5f-e18d-4694-96fd-3ae783d383e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f437557f8d5840c0824980a63e11ce94, user_id=b19de893206941b3b5c975e035fb604b, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:39.970143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f8c5f-e18d-4694-96fd-3ae783d383e9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:39.985688 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 807/1585] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:39 2022] PUT /identity/v3/projects/f437557f8d5840c0824980a63e11ce94/users/b19de893206941b3b5c975e035fb604b/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:39.987274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f8c5f-e18d-4694-96fd-3ae783d383e9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.011957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8051a23-7254-4cd5-9f53-18e14a3024c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.012588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8051a23-7254-4cd5-9f53-18e14a3024c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.013020 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8051a23-7254-4cd5-9f53-18e14a3024c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.013219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8051a23-7254-4cd5-9f53-18e14a3024c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.013931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8051a23-7254-4cd5-9f53-18e14a3024c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.016000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8051a23-7254-4cd5-9f53-18e14a3024c5 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.039597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 779/1586] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:40.040294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8051a23-7254-4cd5-9f53-18e14a3024c5 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.051697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8051a23-7254-4cd5-9f53-18e14a3024c5 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.075279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f8c5f-e18d-4694-96fd-3ae783d383e9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.080805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d92ed-b695-4356-a646-bdddd3d74dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.081480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d92ed-b695-4356-a646-bdddd3d74dda admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.081759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d92ed-b695-4356-a646-bdddd3d74dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.082100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d92ed-b695-4356-a646-bdddd3d74dda admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.082945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d92ed-b695-4356-a646-bdddd3d74dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.085005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d92ed-b695-4356-a646-bdddd3d74dda admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.114974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 808/1587] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:39 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:40.116465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d92ed-b695-4356-a646-bdddd3d74dda admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.121168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7975c5-849e-42f3-8631-b4f29041db6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.122030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7975c5-849e-42f3-8631-b4f29041db6a admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.122378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7975c5-849e-42f3-8631-b4f29041db6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.122766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7975c5-849e-42f3-8631-b4f29041db6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.123554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7975c5-849e-42f3-8631-b4f29041db6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.125234 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7975c5-849e-42f3-8631-b4f29041db6a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.128692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d92ed-b695-4356-a646-bdddd3d74dda admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.136517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f656f-ba39-4171-bc09-f075f9a1613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.137463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f656f-ba39-4171-bc09-f075f9a1613d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.137911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f656f-ba39-4171-bc09-f075f9a1613d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.138278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f656f-ba39-4171-bc09-f075f9a1613d admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.138859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 780/1588] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:40.139219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f656f-ba39-4171-bc09-f075f9a1613d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.140268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193868e7-e4dd-4048-8637-d0d11ccf3025 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.140566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193868e7-e4dd-4048-8637-d0d11ccf3025 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.140843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193868e7-e4dd-4048-8637-d0d11ccf3025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.142107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f656f-ba39-4171-bc09-f075f9a1613d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.160476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 809/1589] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:40.161315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-193868e7-e4dd-4048-8637-d0d11ccf3025 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:40.161794 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f656f-ba39-4171-bc09-f075f9a1613d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.162640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-193868e7-e4dd-4048-8637-d0d11ccf3025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:40.175695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 781/1590] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:40.175695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ddcc-1506-4338-83be-0eb852d77741 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.175695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ddcc-1506-4338-83be-0eb852d77741 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.175695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8ddcc-1506-4338-83be-0eb852d77741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.184750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f656f-ba39-4171-bc09-f075f9a1613d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.200022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99166bb-b99e-4f95-b3bb-d9832c91c9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.201126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99166bb-b99e-4f95-b3bb-d9832c91c9da admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.201483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a0e8ddcc-1506-4338-83be-0eb852d77741 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:40.201607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99166bb-b99e-4f95-b3bb-d9832c91c9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.202026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99166bb-b99e-4f95-b3bb-d9832c91c9da admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.203170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a0e8ddcc-1506-4338-83be-0eb852d77741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:40.203429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99166bb-b99e-4f95-b3bb-d9832c91c9da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.207146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99166bb-b99e-4f95-b3bb-d9832c91c9da admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.212037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 782/1591] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:40.213257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169b85-61da-4f35-9549-860cdc74aae7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.213650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169b85-61da-4f35-9549-860cdc74aae7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.214038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169b85-61da-4f35-9549-860cdc74aae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.247528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 810/1592] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:40 2022] POST /identity/v3/users => generated 303 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:40.249291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99166bb-b99e-4f95-b3bb-d9832c91c9da admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.264208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-6b169b85-61da-4f35-9549-860cdc74aae7 None None] MFA Rules not processed for user `b19de893206941b3b5c975e035fb604b`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:40.265333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99166bb-b99e-4f95-b3bb-d9832c91c9da admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.265480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6b169b85-61da-4f35-9549-860cdc74aae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:40.271930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519bc14-d866-4801-a321-44ee49309c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.272707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519bc14-d866-4801-a321-44ee49309c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.273050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519bc14-d866-4801-a321-44ee49309c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.273394 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519bc14-d866-4801-a321-44ee49309c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.274662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519bc14-d866-4801-a321-44ee49309c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.277610 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519bc14-d866-4801-a321-44ee49309c32 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.297275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 811/1593] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:40.297911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519bc14-d866-4801-a321-44ee49309c32 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.312334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519bc14-d866-4801-a321-44ee49309c32 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.318653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c6906-7eaf-4443-bac3-c579de84d731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.320501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c6906-7eaf-4443-bac3-c579de84d731 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.320501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c6906-7eaf-4443-bac3-c579de84d731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.320501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c6906-7eaf-4443-bac3-c579de84d731 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.321031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c6906-7eaf-4443-bac3-c579de84d731 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.322443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c6906-7eaf-4443-bac3-c579de84d731 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.333423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 812/1594] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:40.334689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c6906-7eaf-4443-bac3-c579de84d731 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.340161 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.346711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c6906-7eaf-4443-bac3-c579de84d731 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.352700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f5d65-e181-453b-8790-9355243a2adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.353410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f5d65-e181-453b-8790-9355243a2adc admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.353695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f5d65-e181-453b-8790-9355243a2adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.353972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f5d65-e181-453b-8790-9355243a2adc admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.354734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f5d65-e181-453b-8790-9355243a2adc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.356779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f5d65-e181-453b-8790-9355243a2adc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.368252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 783/1595] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:40.369436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b169b85-61da-4f35-9549-860cdc74aae7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.371577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 813/1596] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:40.372502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f5d65-e181-453b-8790-9355243a2adc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.385910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b169b85-61da-4f35-9549-860cdc74aae7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.393531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9eb49-9d76-4fd8-a738-209c0d42e573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.394482 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9eb49-9d76-4fd8-a738-209c0d42e573 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.394625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9eb49-9d76-4fd8-a738-209c0d42e573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.395069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9eb49-9d76-4fd8-a738-209c0d42e573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.396023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9eb49-9d76-4fd8-a738-209c0d42e573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.397578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9eb49-9d76-4fd8-a738-209c0d42e573 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.411442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 784/1597] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:40.412330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9eb49-9d76-4fd8-a738-209c0d42e573 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.414060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9fb9eb49-9d76-4fd8-a738-209c0d42e573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:40.420040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.449267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f5d65-e181-453b-8790-9355243a2adc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.453076 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032584-50a2-4ef1-be4f-56cf05f9eee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.453760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032584-50a2-4ef1-be4f-56cf05f9eee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.454045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032584-50a2-4ef1-be4f-56cf05f9eee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.454356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a032584-50a2-4ef1-be4f-56cf05f9eee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.464804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a032584-50a2-4ef1-be4f-56cf05f9eee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.466254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a032584-50a2-4ef1-be4f-56cf05f9eee5 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.478216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 814/1598] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:40.479021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032584-50a2-4ef1-be4f-56cf05f9eee5 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.490458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9eb49-9d76-4fd8-a738-209c0d42e573 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.490829 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a032584-50a2-4ef1-be4f-56cf05f9eee5 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.496130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bfed1-5b81-45c9-8589-0904a77a2a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.497068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bfed1-5b81-45c9-8589-0904a77a2a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.497354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bfed1-5b81-45c9-8589-0904a77a2a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.497709 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479bfed1-5b81-45c9-8589-0904a77a2a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.499058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83d1fa-6153-47a3-9615-8eb46767083e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.499978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83d1fa-6153-47a3-9615-8eb46767083e admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.500584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83d1fa-6153-47a3-9615-8eb46767083e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.501327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83d1fa-6153-47a3-9615-8eb46767083e admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.502443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83d1fa-6153-47a3-9615-8eb46767083e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.504631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83d1fa-6153-47a3-9615-8eb46767083e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.511801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bfed1-5b81-45c9-8589-0904a77a2a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.513270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479bfed1-5b81-45c9-8589-0904a77a2a8a service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.516465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 815/1599] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:40.520005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83d1fa-6153-47a3-9615-8eb46767083e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.525820 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 785/1600] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:40.527284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bfed1-5b81-45c9-8589-0904a77a2a8a service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.537999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479bfed1-5b81-45c9-8589-0904a77a2a8a service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.539089 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83d1fa-6153-47a3-9615-8eb46767083e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.543247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30752d-0b2f-4fb2-92bc-3eae52ddb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.544050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30752d-0b2f-4fb2-92bc-3eae52ddb509 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.544438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30752d-0b2f-4fb2-92bc-3eae52ddb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.544869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30752d-0b2f-4fb2-92bc-3eae52ddb509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.545795 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278fe70-e4a9-459d-a6cc-16488cd04de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.545974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30752d-0b2f-4fb2-92bc-3eae52ddb509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.547505 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278fe70-e4a9-459d-a6cc-16488cd04de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.547981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278fe70-e4a9-459d-a6cc-16488cd04de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.548632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278fe70-e4a9-459d-a6cc-16488cd04de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.548750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30752d-0b2f-4fb2-92bc-3eae52ddb509 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.550619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278fe70-e4a9-459d-a6cc-16488cd04de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.554011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278fe70-e4a9-459d-a6cc-16488cd04de3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.563630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 786/1601] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:40.564955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30752d-0b2f-4fb2-92bc-3eae52ddb509 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.570241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 816/1602] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:40.570241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e3f4-03b1-4c97-bae4-52d075f5f4b1 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.572356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e3f4-03b1-4c97-bae4-52d075f5f4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.572661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424e3f4-03b1-4c97-bae4-52d075f5f4b1 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.575075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 817/1603] 10.222.0.79 () {54 vars in 961 bytes} [Wed May 25 14:42:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:40.575923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e3f4-03b1-4c97-bae4-52d075f5f4b1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.581328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30752d-0b2f-4fb2-92bc-3eae52ddb509 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.597643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424e3f4-03b1-4c97-bae4-52d075f5f4b1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.598318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aea3fe-d128-4476-bbfb-d04c689206d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.599713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aea3fe-d128-4476-bbfb-d04c689206d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.600482 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aea3fe-d128-4476-bbfb-d04c689206d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.601335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aea3fe-d128-4476-bbfb-d04c689206d9 admin admin] PATH_INFO: `/v3/projects/6029f080cf6e4a97878efea92c45357a/users/4e2fc01480c04ff2988700d0474adebc/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.603346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad3507-be91-493c-8b79-7d0d0b376c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.604349 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad3507-be91-493c-8b79-7d0d0b376c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.604689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad3507-be91-493c-8b79-7d0d0b376c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.605019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad3507-be91-493c-8b79-7d0d0b376c33 admin admin] PATH_INFO: `/v3/projects/32777bb10850414495c96c6619cfd85a/users/43fc4ad124f943c086954c28a0a6e199/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.628169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad3507-be91-493c-8b79-7d0d0b376c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32777bb10850414495c96c6619cfd85a, user_id=43fc4ad124f943c086954c28a0a6e199, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.632685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad3507-be91-493c-8b79-7d0d0b376c33 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.634379 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aea3fe-d128-4476-bbfb-d04c689206d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6029f080cf6e4a97878efea92c45357a, user_id=4e2fc01480c04ff2988700d0474adebc, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.638456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aea3fe-d128-4476-bbfb-d04c689206d9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.653540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 818/1604] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:40 2022] PUT /identity/v3/projects/32777bb10850414495c96c6619cfd85a/users/43fc4ad124f943c086954c28a0a6e199/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:40.655810 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad3507-be91-493c-8b79-7d0d0b376c33 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.669015 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 787/1605] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:40 2022] PUT /identity/v3/projects/6029f080cf6e4a97878efea92c45357a/users/4e2fc01480c04ff2988700d0474adebc/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:40.670295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aea3fe-d128-4476-bbfb-d04c689206d9 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.775105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad3507-be91-493c-8b79-7d0d0b376c33 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.795765 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aea3fe-d128-4476-bbfb-d04c689206d9 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.803205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d31d2-c585-4897-9e32-26f89e5179a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.804468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d31d2-c585-4897-9e32-26f89e5179a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.804752 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d31d2-c585-4897-9e32-26f89e5179a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.805081 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d31d2-c585-4897-9e32-26f89e5179a2 admin admin] PATH_INFO: `/v3/projects/b9c62ce8366c4a5593361d4fbb9d1a0f/users/ae07dc573937439b8e3bf4f3e8b5774c/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.831470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d31d2-c585-4897-9e32-26f89e5179a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9c62ce8366c4a5593361d4fbb9d1a0f, user_id=ae07dc573937439b8e3bf4f3e8b5774c, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.835603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d31d2-c585-4897-9e32-26f89e5179a2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.863956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 788/1606] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:40 2022] PUT /identity/v3/projects/b9c62ce8366c4a5593361d4fbb9d1a0f/users/ae07dc573937439b8e3bf4f3e8b5774c/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:40.865187 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d31d2-c585-4897-9e32-26f89e5179a2 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:40.876042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.891695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeed2a1-8535-4181-814a-30fdfb1cf27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.892544 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeed2a1-8535-4181-814a-30fdfb1cf27c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.893467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeed2a1-8535-4181-814a-30fdfb1cf27c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.893763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeed2a1-8535-4181-814a-30fdfb1cf27c admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.894539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeed2a1-8535-4181-814a-30fdfb1cf27c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.896386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeed2a1-8535-4181-814a-30fdfb1cf27c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:40.912734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 819/1607] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:40.919526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c7bfe-c4ab-4440-bb15-0005df2d22aa None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.921287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c7bfe-c4ab-4440-bb15-0005df2d22aa None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.921720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c7bfe-c4ab-4440-bb15-0005df2d22aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.936381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:40.948951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-984c7bfe-c4ab-4440-bb15-0005df2d22aa None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:40.950780 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-984c7bfe-c4ab-4440-bb15-0005df2d22aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:40.952827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d31d2-c585-4897-9e32-26f89e5179a2 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:40.959361 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b3880-6ad3-4d22-bf9c-67130f5fdd7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:40.960328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b3880-6ad3-4d22-bf9c-67130f5fdd7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:40.960622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b3880-6ad3-4d22-bf9c-67130f5fdd7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:40.960959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b3880-6ad3-4d22-bf9c-67130f5fdd7c admin admin] PATH_INFO: `/v3/projects/3c194983b53d4d5dbf50139065be99c0/users/328ff52c19764f788fa544ecefe83733/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:40.983934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b3880-6ad3-4d22-bf9c-67130f5fdd7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c194983b53d4d5dbf50139065be99c0, user_id=328ff52c19764f788fa544ecefe83733, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:40.986855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b3880-6ad3-4d22-bf9c-67130f5fdd7c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.015006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 789/1608] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:40 2022] PUT /identity/v3/projects/3c194983b53d4d5dbf50139065be99c0/users/328ff52c19764f788fa544ecefe83733/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:41.016941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512cc5-9ee5-4ea2-a54e-b80d822bf2c9 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.018595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512cc5-9ee5-4ea2-a54e-b80d822bf2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.019041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c512cc5-9ee5-4ea2-a54e-b80d822bf2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.049297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-4c512cc5-9ee5-4ea2-a54e-b80d822bf2c9 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:41.051006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4c512cc5-9ee5-4ea2-a54e-b80d822bf2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.068918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 820/1609] 10.222.0.79 () {58 vars in 1058 bytes} [Wed May 25 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:41.070989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c60054-1202-446b-a658-ea657ae0e6af None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.071279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c60054-1202-446b-a658-ea657ae0e6af None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.071561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c60054-1202-446b-a658-ea657ae0e6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.099006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b6c60054-1202-446b-a658-ea657ae0e6af None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:41.100804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b6c60054-1202-446b-a658-ea657ae0e6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.226034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 790/1610] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:41.229060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083d7e2-7e77-4328-a81c-392f0eeeebd5 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.229309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083d7e2-7e77-4328-a81c-392f0eeeebd5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.229717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7083d7e2-7e77-4328-a81c-392f0eeeebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.240625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 821/1611] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:41.242222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c60054-1202-446b-a658-ea657ae0e6af None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.256087 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c60054-1202-446b-a658-ea657ae0e6af None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.264163 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab59e01-2d2b-41e7-8e97-019cfb2f03a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.265817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab59e01-2d2b-41e7-8e97-019cfb2f03a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.266204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab59e01-2d2b-41e7-8e97-019cfb2f03a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.266521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab59e01-2d2b-41e7-8e97-019cfb2f03a2 admin admin] PATH_INFO: `/v3/projects/72bee817b43543dbbd33c66a1c3151f2/users/af290a0e2a7b4602a6d146226e0eb36d/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.301266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7083d7e2-7e77-4328-a81c-392f0eeeebd5 None None] MFA Rules not processed for user `ae07dc573937439b8e3bf4f3e8b5774c`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:41.302833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7083d7e2-7e77-4328-a81c-392f0eeeebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.304286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab59e01-2d2b-41e7-8e97-019cfb2f03a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bee817b43543dbbd33c66a1c3151f2, user_id=af290a0e2a7b4602a6d146226e0eb36d, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.311763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab59e01-2d2b-41e7-8e97-019cfb2f03a2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.338748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 822/1612] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:41 2022] PUT /identity/v3/projects/72bee817b43543dbbd33c66a1c3151f2/users/af290a0e2a7b4602a6d146226e0eb36d/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:41.344546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679276-6a02-40e6-8b02-6b6d7025f84a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.344919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679276-6a02-40e6-8b02-6b6d7025f84a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.345153 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31679276-6a02-40e6-8b02-6b6d7025f84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.366583 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-31679276-6a02-40e6-8b02-6b6d7025f84a None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:41.368469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-31679276-6a02-40e6-8b02-6b6d7025f84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.383288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 791/1613] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:41.384222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083d7e2-7e77-4328-a81c-392f0eeeebd5 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.474265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.480617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7083d7e2-7e77-4328-a81c-392f0eeeebd5 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.481530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:41.498396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 823/1614] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:41.504620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31679276-6a02-40e6-8b02-6b6d7025f84a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.644876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8af4ce-b1dd-4ea6-9a84-423e8d981d1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.645773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8af4ce-b1dd-4ea6-9a84-423e8d981d1c service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.646165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8af4ce-b1dd-4ea6-9a84-423e8d981d1c service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.646563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8af4ce-b1dd-4ea6-9a84-423e8d981d1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.654793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31679276-6a02-40e6-8b02-6b6d7025f84a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.661159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b42f3d-4ed1-44ab-ad34-66e97a1a059a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.662808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42f3d-4ed1-44ab-ad34-66e97a1a059a service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.663172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42f3d-4ed1-44ab-ad34-66e97a1a059a service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.663530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b42f3d-4ed1-44ab-ad34-66e97a1a059a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.679403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b42f3d-4ed1-44ab-ad34-66e97a1a059a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.682658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b42f3d-4ed1-44ab-ad34-66e97a1a059a service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.709527 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 824/1615] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:41.710812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b42f3d-4ed1-44ab-ad34-66e97a1a059a service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.734853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b42f3d-4ed1-44ab-ad34-66e97a1a059a service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.743922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee36c26-ba71-436e-a964-0282cff4d131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.745506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee36c26-ba71-436e-a964-0282cff4d131 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.745852 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee36c26-ba71-436e-a964-0282cff4d131 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.746883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee36c26-ba71-436e-a964-0282cff4d131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.773326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8af4ce-b1dd-4ea6-9a84-423e8d981d1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.775349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8af4ce-b1dd-4ea6-9a84-423e8d981d1c service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.775646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee36c26-ba71-436e-a964-0282cff4d131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.779608 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee36c26-ba71-436e-a964-0282cff4d131 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.799064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 825/1616] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:41.800706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032646ee-4b61-43d7-a2cb-12ba8bbe49ad None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.801653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032646ee-4b61-43d7-a2cb-12ba8bbe49ad None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.802127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032646ee-4b61-43d7-a2cb-12ba8bbe49ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.802305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 792/1617] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:41.806685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8af4ce-b1dd-4ea6-9a84-423e8d981d1c service nova] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.831305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8af4ce-b1dd-4ea6-9a84-423e8d981d1c service nova] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.832732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-032646ee-4b61-43d7-a2cb-12ba8bbe49ad None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:41.835381 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-032646ee-4b61-43d7-a2cb-12ba8bbe49ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:41.843536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328c3f5-242b-4e91-a431-634c6ef72cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.844291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328c3f5-242b-4e91-a431-634c6ef72cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.845715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328c3f5-242b-4e91-a431-634c6ef72cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.846104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328c3f5-242b-4e91-a431-634c6ef72cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.849362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328c3f5-242b-4e91-a431-634c6ef72cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.857590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328c3f5-242b-4e91-a431-634c6ef72cf0 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.867363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 826/1618] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:41.868352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032646ee-4b61-43d7-a2cb-12ba8bbe49ad None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.900530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032646ee-4b61-43d7-a2cb-12ba8bbe49ad None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:41.909834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f82d56-f03f-46ba-ae48-f5bc8f91265e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:41.910577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f82d56-f03f-46ba-ae48-f5bc8f91265e service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:41.910859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f82d56-f03f-46ba-ae48-f5bc8f91265e service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:41.911197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f82d56-f03f-46ba-ae48-f5bc8f91265e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:41.936302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 793/1619] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:41.943080 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f82d56-f03f-46ba-ae48-f5bc8f91265e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:41.945595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328c3f5-242b-4e91-a431-634c6ef72cf0 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.946137 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f82d56-f03f-46ba-ae48-f5bc8f91265e service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:41.972666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 827/1620] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:41.973639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f82d56-f03f-46ba-ae48-f5bc8f91265e service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:41.995244 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f82d56-f03f-46ba-ae48-f5bc8f91265e service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.075332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328c3f5-242b-4e91-a431-634c6ef72cf0 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.086309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa55e7-340e-4643-9dca-42642c6e5927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.086930 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa55e7-340e-4643-9dca-42642c6e5927 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.087211 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa55e7-340e-4643-9dca-42642c6e5927 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.088265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa55e7-340e-4643-9dca-42642c6e5927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.145402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d104bba-9ebb-41a6-8b8b-6e192465955f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.146191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104bba-9ebb-41a6-8b8b-6e192465955f admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.146478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104bba-9ebb-41a6-8b8b-6e192465955f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.146805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d104bba-9ebb-41a6-8b8b-6e192465955f admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.147566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d104bba-9ebb-41a6-8b8b-6e192465955f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.149805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d104bba-9ebb-41a6-8b8b-6e192465955f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.168682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.182555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 828/1621] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:41 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:42.187861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6533b0-e239-44a5-8984-7044c25d6168 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.188315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6533b0-e239-44a5-8984-7044c25d6168 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.188608 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6533b0-e239-44a5-8984-7044c25d6168 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.190348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 829/1622] 10.222.0.79 () {54 vars in 912 bytes} [Wed May 25 14:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:42.191107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6533b0-e239-44a5-8984-7044c25d6168 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.218424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6533b0-e239-44a5-8984-7044c25d6168 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.225730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa55e7-340e-4643-9dca-42642c6e5927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.228595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa55e7-340e-4643-9dca-42642c6e5927 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.231736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a87e7-4bf5-4d2d-8182-b9e18d0692fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.232537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a87e7-4bf5-4d2d-8182-b9e18d0692fb admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.232899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a87e7-4bf5-4d2d-8182-b9e18d0692fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.234174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a87e7-4bf5-4d2d-8182-b9e18d0692fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.235028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a87e7-4bf5-4d2d-8182-b9e18d0692fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.239776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a87e7-4bf5-4d2d-8182-b9e18d0692fb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.241415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 794/1623] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:42.243544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb44f7-e7a6-4ac9-acef-c382763bcfc1 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.245185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb44f7-e7a6-4ac9-acef-c382763bcfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.245721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb44f7-e7a6-4ac9-acef-c382763bcfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.268892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 830/1624] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:42.273033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a87e7-4bf5-4d2d-8182-b9e18d0692fb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.273626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-4adb44f7-e7a6-4ac9-acef-c382763bcfc1 None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:42.275498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4adb44f7-e7a6-4ac9-acef-c382763bcfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:42.297023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a87e7-4bf5-4d2d-8182-b9e18d0692fb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.309710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35151fbb-9573-4fdd-943d-d920c3664f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.311841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151fbb-9573-4fdd-943d-d920c3664f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.312141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151fbb-9573-4fdd-943d-d920c3664f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.313364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35151fbb-9573-4fdd-943d-d920c3664f3e admin admin] PATH_INFO: `/v3/projects/641b341127d44060b3cc7473dbf845e7/users/83cc353e0f68422480f9c4acb403a792/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.358619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35151fbb-9573-4fdd-943d-d920c3664f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=641b341127d44060b3cc7473dbf845e7, user_id=83cc353e0f68422480f9c4acb403a792, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.361578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35151fbb-9573-4fdd-943d-d920c3664f3e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.381293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 831/1625] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:42 2022] PUT /identity/v3/projects/641b341127d44060b3cc7473dbf845e7/users/83cc353e0f68422480f9c4acb403a792/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:42.386116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35151fbb-9573-4fdd-943d-d920c3664f3e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.404287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 795/1626] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:42.423541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb44f7-e7a6-4ac9-acef-c382763bcfc1 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.456023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.519098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb44f7-e7a6-4ac9-acef-c382763bcfc1 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.545374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35151fbb-9573-4fdd-943d-d920c3664f3e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.561678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bfbca-4e7b-4c12-8719-0ee027f092be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.562413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bfbca-4e7b-4c12-8719-0ee027f092be admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.562843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bfbca-4e7b-4c12-8719-0ee027f092be admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.563080 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bfbca-4e7b-4c12-8719-0ee027f092be admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.563842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bfbca-4e7b-4c12-8719-0ee027f092be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.567629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bfbca-4e7b-4c12-8719-0ee027f092be admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.592014 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 832/1627] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:42.595060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bfbca-4e7b-4c12-8719-0ee027f092be admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.603632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965fcc0-bc50-4cbc-b9f3-8de2bcc0c00c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.605378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965fcc0-bc50-4cbc-b9f3-8de2bcc0c00c service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.605987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965fcc0-bc50-4cbc-b9f3-8de2bcc0c00c service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.607386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965fcc0-bc50-4cbc-b9f3-8de2bcc0c00c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.618533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bfbca-4e7b-4c12-8719-0ee027f092be admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:42.631567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb95ff-e759-4499-9311-d4637ccc709b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:42.633504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb95ff-e759-4499-9311-d4637ccc709b admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.633796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb95ff-e759-4499-9311-d4637ccc709b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.634105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb95ff-e759-4499-9311-d4637ccc709b admin admin] PATH_INFO: `/v3/projects/641b341127d44060b3cc7473dbf845e7/users/83cc353e0f68422480f9c4acb403a792/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.640970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb95ff-e759-4499-9311-d4637ccc709b admin admin] RBAC: Authorizing `identity:create_grant(project_id=641b341127d44060b3cc7473dbf845e7, user_id=83cc353e0f68422480f9c4acb403a792, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.646698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb95ff-e759-4499-9311-d4637ccc709b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.669284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:42.673280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 833/1628] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:42 2022] PUT /identity/v3/projects/641b341127d44060b3cc7473dbf845e7/users/83cc353e0f68422480f9c4acb403a792/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:42.685386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757dc2-277e-45de-9030-1d8b342d16dd None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:42.685785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757dc2-277e-45de-9030-1d8b342d16dd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:42.686328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e757dc2-277e-45de-9030-1d8b342d16dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:42.722180 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5e757dc2-277e-45de-9030-1d8b342d16dd None None] MFA Rules not processed for user `83cc353e0f68422480f9c4acb403a792`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:42.724318 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5e757dc2-277e-45de-9030-1d8b342d16dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:42.744508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965fcc0-bc50-4cbc-b9f3-8de2bcc0c00c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:42.747262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965fcc0-bc50-4cbc-b9f3-8de2bcc0c00c service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:42.783903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 796/1629] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:42.856371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 834/1630] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:42.871892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965fcc0-bc50-4cbc-b9f3-8de2bcc0c00c service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:42.890861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965fcc0-bc50-4cbc-b9f3-8de2bcc0c00c service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.044790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a0d77a-06a3-47e0-8c40-9f2c7a7aeb4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.045791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d77a-06a3-47e0-8c40-9f2c7a7aeb4a service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.046300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d77a-06a3-47e0-8c40-9f2c7a7aeb4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.047119 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a0d77a-06a3-47e0-8c40-9f2c7a7aeb4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.075080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0d77a-06a3-47e0-8c40-9f2c7a7aeb4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.076738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a0d77a-06a3-47e0-8c40-9f2c7a7aeb4a service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.099186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 797/1631] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:43.295031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e757dc2-277e-45de-9030-1d8b342d16dd None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:43.311650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e757dc2-277e-45de-9030-1d8b342d16dd None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:43.325602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b042b-8d20-4ed5-b511-87b716c609cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:43.330403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b042b-8d20-4ed5-b511-87b716c609cf service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:43.330806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b042b-8d20-4ed5-b511-87b716c609cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:43.331194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b042b-8d20-4ed5-b511-87b716c609cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:43.483045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b042b-8d20-4ed5-b511-87b716c609cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:43.486562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b042b-8d20-4ed5-b511-87b716c609cf service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:43.523754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 835/1632] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:44.624591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da275c-1029-4947-bd62-d2b1dd0056d5 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.625319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da275c-1029-4947-bd62-d2b1dd0056d5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.625319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da275c-1029-4947-bd62-d2b1dd0056d5 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.627087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 798/1633] 10.222.0.79 () {54 vars in 961 bytes} [Wed May 25 14:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:44.645667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b28044-866f-440e-aef3-a18d5cb7a0a4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.646469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b28044-866f-440e-aef3-a18d5cb7a0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.646469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b28044-866f-440e-aef3-a18d5cb7a0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.676694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-08b28044-866f-440e-aef3-a18d5cb7a0a4 None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:44.677927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-08b28044-866f-440e-aef3-a18d5cb7a0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:44.730482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:44.807162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 836/1634] 10.222.0.79 () {58 vars in 1058 bytes} [Wed May 25 14:42:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:44.812005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc3de-9a8e-4633-b45b-6de938a6fdbb None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.812334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc3de-9a8e-4633-b45b-6de938a6fdbb None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.812573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fc3de-9a8e-4633-b45b-6de938a6fdbb None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.814416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 799/1635] 10.222.0.79 () {54 vars in 912 bytes} [Wed May 25 14:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:44.822655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177321-ed2d-49de-9bd8-453f5446830c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.823722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177321-ed2d-49de-9bd8-453f5446830c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.824222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85177321-ed2d-49de-9bd8-453f5446830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:44.905110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-85177321-ed2d-49de-9bd8-453f5446830c None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:44.907075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-85177321-ed2d-49de-9bd8-453f5446830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:44.949514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 837/1636] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:42:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:44.964868 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc3de-9a8e-4633-b45b-6de938a6fdbb None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:44.983841 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fc3de-9a8e-4633-b45b-6de938a6fdbb None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:44.992441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc21ee9-8860-4f0e-99fc-9ee0cd769547 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:44.995577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc21ee9-8860-4f0e-99fc-9ee0cd769547 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:44.995871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc21ee9-8860-4f0e-99fc-9ee0cd769547 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:44.996457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc21ee9-8860-4f0e-99fc-9ee0cd769547 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.022229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc21ee9-8860-4f0e-99fc-9ee0cd769547 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:45.023844 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc21ee9-8860-4f0e-99fc-9ee0cd769547 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:45.039498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 800/1637] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:45.224633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe926c-7854-4b24-a05a-9d81ec2d3708 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:45.224923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe926c-7854-4b24-a05a-9d81ec2d3708 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:45.225205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe926c-7854-4b24-a05a-9d81ec2d3708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.266297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5bbe926c-7854-4b24-a05a-9d81ec2d3708 None None] MFA Rules not processed for user `328ff52c19764f788fa544ecefe83733`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:45.268337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5bbe926c-7854-4b24-a05a-9d81ec2d3708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:45.406672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e0df8-71fb-4fbb-881f-72ad7d708850 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:45.407565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e0df8-71fb-4fbb-881f-72ad7d708850 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:45.407848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e0df8-71fb-4fbb-881f-72ad7d708850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.464035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 838/1638] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:45.480395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1f0e5-be6a-43ef-9e04-2ff13431c866 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:45.480612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1f0e5-be6a-43ef-9e04-2ff13431c866 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:45.480894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1f0e5-be6a-43ef-9e04-2ff13431c866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.497709 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-155e0df8-71fb-4fbb-881f-72ad7d708850 None None] MFA Rules not processed for user `af290a0e2a7b4602a6d146226e0eb36d`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:45.509215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-155e0df8-71fb-4fbb-881f-72ad7d708850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:45.559316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-52d1f0e5-be6a-43ef-9e04-2ff13431c866 None None] MFA Rules not processed for user `328ff52c19764f788fa544ecefe83733`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:45.560571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-52d1f0e5-be6a-43ef-9e04-2ff13431c866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:45.587239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 839/1639] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:45.600352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1f0e5-be6a-43ef-9e04-2ff13431c866 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:45.633792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1f0e5-be6a-43ef-9e04-2ff13431c866 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:45.653198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a0c2d-268a-4e2d-912b-d58ebd620044 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:45.653915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0c2d-268a-4e2d-912b-d58ebd620044 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:45.654226 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0c2d-268a-4e2d-912b-d58ebd620044 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:45.654672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a0c2d-268a-4e2d-912b-d58ebd620044 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:45.683435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a0c2d-268a-4e2d-912b-d58ebd620044 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:45.685359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a0c2d-268a-4e2d-912b-d58ebd620044 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:45.717245 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 840/1640] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:45.870003 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 801/1641] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:45.871457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a0c2d-268a-4e2d-912b-d58ebd620044 service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.067519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a0c2d-268a-4e2d-912b-d58ebd620044 service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.087896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3656-02df-4354-8a5a-9d67918dbd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.088734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3656-02df-4354-8a5a-9d67918dbd28 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.089037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3656-02df-4354-8a5a-9d67918dbd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.090834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd3656-02df-4354-8a5a-9d67918dbd28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.092108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd3656-02df-4354-8a5a-9d67918dbd28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.098756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd3656-02df-4354-8a5a-9d67918dbd28 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.180047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 841/1642] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:45 2022] POST /identity/v3/projects => generated 405 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:46.183823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e0df8-71fb-4fbb-881f-72ad7d708850 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.204213 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e0df8-71fb-4fbb-881f-72ad7d708850 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.289840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:46.341482 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba591d73-180b-4355-ad3f-964508d23da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.342405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba591d73-180b-4355-ad3f-964508d23da5 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.343065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba591d73-180b-4355-ad3f-964508d23da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.347631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba591d73-180b-4355-ad3f-964508d23da5 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.348599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba591d73-180b-4355-ad3f-964508d23da5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.350802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba591d73-180b-4355-ad3f-964508d23da5 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.393872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 802/1643] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:46 2022] POST /identity/v3/users => generated 309 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:46.398549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3656-02df-4354-8a5a-9d67918dbd28 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.419175 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd3656-02df-4354-8a5a-9d67918dbd28 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.440165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df691f-7d5d-4339-b78d-c0e163ede83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.440787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df691f-7d5d-4339-b78d-c0e163ede83f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.441290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df691f-7d5d-4339-b78d-c0e163ede83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.441653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df691f-7d5d-4339-b78d-c0e163ede83f admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.442455 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df691f-7d5d-4339-b78d-c0e163ede83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.444141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df691f-7d5d-4339-b78d-c0e163ede83f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.472138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:46.497811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 842/1644] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:46.503407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba591d73-180b-4355-ad3f-964508d23da5 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.523794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba591d73-180b-4355-ad3f-964508d23da5 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.559038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597e6a9-878b-4db6-a038-feb889b344a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.559038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e6a9-878b-4db6-a038-feb889b344a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.559038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e6a9-878b-4db6-a038-feb889b344a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.559038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597e6a9-878b-4db6-a038-feb889b344a6 admin admin] PATH_INFO: `/v3/projects/1001c2ac80e2494296f741f8742f9403/users/512b9c6cf0d5458da0efff5b25c527c7/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.613794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597e6a9-878b-4db6-a038-feb889b344a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1001c2ac80e2494296f741f8742f9403, user_id=512b9c6cf0d5458da0efff5b25c527c7, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.620231 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597e6a9-878b-4db6-a038-feb889b344a6 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.663232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 803/1645] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:46 2022] PUT /identity/v3/projects/1001c2ac80e2494296f741f8742f9403/users/512b9c6cf0d5458da0efff5b25c527c7/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:46.668554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df691f-7d5d-4339-b78d-c0e163ede83f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.680590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df691f-7d5d-4339-b78d-c0e163ede83f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.750469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad2997-038d-47f2-add8-6abd1141f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.751826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad2997-038d-47f2-add8-6abd1141f1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.752386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad2997-038d-47f2-add8-6abd1141f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.752861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad2997-038d-47f2-add8-6abd1141f1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.753822 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad2997-038d-47f2-add8-6abd1141f1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.755740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad2997-038d-47f2-add8-6abd1141f1d6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.769386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 843/1646] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:46 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:46.775047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597e6a9-878b-4db6-a038-feb889b344a6 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.789423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597e6a9-878b-4db6-a038-feb889b344a6 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:46.805981 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a169b-f5f3-4876-abad-bfbcfb015699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:46.809732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a169b-f5f3-4876-abad-bfbcfb015699 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:46.810222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a169b-f5f3-4876-abad-bfbcfb015699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:46.810613 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a169b-f5f3-4876-abad-bfbcfb015699 admin admin] PATH_INFO: `/v3/projects/1001c2ac80e2494296f741f8742f9403/users/512b9c6cf0d5458da0efff5b25c527c7/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:46.815994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a169b-f5f3-4876-abad-bfbcfb015699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1001c2ac80e2494296f741f8742f9403, user_id=512b9c6cf0d5458da0efff5b25c527c7, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:46.822158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a169b-f5f3-4876-abad-bfbcfb015699 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:46.873861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 804/1647] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:46 2022] PUT /identity/v3/projects/1001c2ac80e2494296f741f8742f9403/users/512b9c6cf0d5458da0efff5b25c527c7/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:46.905582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad2997-038d-47f2-add8-6abd1141f1d6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:46.950305 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad2997-038d-47f2-add8-6abd1141f1d6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:47.152508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:47.154067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.154593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.155091 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] PATH_INFO: `/v3/users/b19de893206941b3b5c975e035fb604b` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.157531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19de893206941b3b5c975e035fb604b)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:47.160147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: WARNING py.warnings [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:42:47.160147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: warnings.warn(msg) May 25 14:42:47.160147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: May 25 14:42:47.162717 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:47.238392 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a037f5-7f40-4650-90b2-60807464df5c None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.238901 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a037f5-7f40-4650-90b2-60807464df5c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.239414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a037f5-7f40-4650-90b2-60807464df5c None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.242011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 805/1648] 10.222.0.79 () {54 vars in 912 bytes} [Wed May 25 14:42:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:47.279931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c109b4b-33f9-4835-bcda-29b1240ce540 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.281959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c109b4b-33f9-4835-bcda-29b1240ce540 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.281959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c109b4b-33f9-4835-bcda-29b1240ce540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.445977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9c109b4b-33f9-4835-bcda-29b1240ce540 None None] MFA Rules not processed for user `e4270ab375e04196ad17f121f4175915`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:47.448097 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9c109b4b-33f9-4835-bcda-29b1240ce540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:47.456040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19de893206941b3b5c975e035fb604b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:47.478006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19de893206941b3b5c975e035fb604b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:47.482991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19de893206941b3b5c975e035fb604b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:47.559590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19de893206941b3b5c975e035fb604b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:47.610989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e143dc99-dfd8-40e8-ac77-94ead0c0231e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19de893206941b3b5c975e035fb604b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:47.637789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 844/1649] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:42:46 2022] DELETE /identity/v3/users/b19de893206941b3b5c975e035fb604b => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:47.640492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38382386-f075-4c6b-810b-9e0c8af6ccf7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:47.640970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38382386-f075-4c6b-810b-9e0c8af6ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:47.641458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38382386-f075-4c6b-810b-9e0c8af6ccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:47.681224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 806/1650] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:42:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 25 14:42:47.707043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-38382386-f075-4c6b-810b-9e0c8af6ccf7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:47.710416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-38382386-f075-4c6b-810b-9e0c8af6ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:47.731326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:47.890832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 845/1651] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:47.924336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c109b4b-33f9-4835-bcda-29b1240ce540 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:47.928788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9c109b4b-33f9-4835-bcda-29b1240ce540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:47.968264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c109b4b-33f9-4835-bcda-29b1240ce540 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.229660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959449a-99e5-477d-9962-9375ee9c9a77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.239463 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959449a-99e5-477d-9962-9375ee9c9a77 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.240198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959449a-99e5-477d-9962-9375ee9c9a77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.241742 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959449a-99e5-477d-9962-9375ee9c9a77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.291810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959449a-99e5-477d-9962-9375ee9c9a77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.295069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959449a-99e5-477d-9962-9375ee9c9a77 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.322525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 807/1652] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:48.340308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38382386-f075-4c6b-810b-9e0c8af6ccf7 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:48.380632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38382386-f075-4c6b-810b-9e0c8af6ccf7 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:48.400842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d013c038-33e2-4a05-987a-c25aa1408303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:48.402630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c038-33e2-4a05-987a-c25aa1408303 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:48.403579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c038-33e2-4a05-987a-c25aa1408303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:48.404166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d013c038-33e2-4a05-987a-c25aa1408303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:48.434178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013c038-33e2-4a05-987a-c25aa1408303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:48.437166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d013c038-33e2-4a05-987a-c25aa1408303 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:48.470970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 846/1653] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:50.117906 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ac5a-5156-4695-8225-17b34d834917 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.118554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ac5a-5156-4695-8225-17b34d834917 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.118731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c18ac5a-5156-4695-8225-17b34d834917 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.120987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 808/1654] 10.222.0.79 () {54 vars in 960 bytes} [Wed May 25 14:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:50.132862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc03c5-9d02-4d34-87c0-0b87a9640b6e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.134798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc03c5-9d02-4d34-87c0-0b87a9640b6e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.135109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc03c5-9d02-4d34-87c0-0b87a9640b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.186864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-49bc03c5-9d02-4d34-87c0-0b87a9640b6e None None] MFA Rules not processed for user `582296b1e43f4d12ab99eec9283b0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:50.188446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-49bc03c5-9d02-4d34-87c0-0b87a9640b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:50.335712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 847/1655] 10.222.0.79 () {58 vars in 1057 bytes} [Wed May 25 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:50.349808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ac5a-5156-4695-8225-17b34d834917 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:50.387850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c18ac5a-5156-4695-8225-17b34d834917 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:50.408182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d059381-48d5-4cd1-a50d-9bd29856cc06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582296b1e43f4d12ab99eec9283b0d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:50.409968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d059381-48d5-4cd1-a50d-9bd29856cc06 service placement] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:50.410457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d059381-48d5-4cd1-a50d-9bd29856cc06 service placement] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:50.410881 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d059381-48d5-4cd1-a50d-9bd29856cc06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:50.418026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9d059381-48d5-4cd1-a50d-9bd29856cc06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:50.463137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d059381-48d5-4cd1-a50d-9bd29856cc06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:50.467997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d059381-48d5-4cd1-a50d-9bd29856cc06 service placement] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:50.502191 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 809/1656] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:51.978406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc03c5-9d02-4d34-87c0-0b87a9640b6e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:51.980400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-49bc03c5-9d02-4d34-87c0-0b87a9640b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:52.006732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc03c5-9d02-4d34-87c0-0b87a9640b6e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:52.041098 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:52.041098 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.041098 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.041098 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] PATH_INFO: `/v3/projects/f437557f8d5840c0824980a63e11ce94` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.041456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f437557f8d5840c0824980a63e11ce94)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:52.042345 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:52.243758 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f437557f8d5840c0824980a63e11ce94', 'request_id': 'req-7b60903a-7243-4d35-94ac-58cd84aaafb2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:52.260931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f437557f8d5840c0824980a63e11ce94', 'request_id': 'req-7b60903a-7243-4d35-94ac-58cd84aaafb2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:52.295335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f437557f8d5840c0824980a63e11ce94', 'request_id': 'req-7b60903a-7243-4d35-94ac-58cd84aaafb2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:52.334565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] The token cache is being invalidate because project f437557f8d5840c0824980a63e11ce94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:42:52.340043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:52.342324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7b60903a-7243-4d35-94ac-58cd84aaafb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:52.344869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 848/1657] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:42:51 2022] DELETE /identity/v3/projects/f437557f8d5840c0824980a63e11ce94 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:52.349884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629fe4-ed2a-4295-834e-a74fa35f8c40 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.353196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629fe4-ed2a-4295-834e-a74fa35f8c40 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.354320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e629fe4-ed2a-4295-834e-a74fa35f8c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.414980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9e629fe4-ed2a-4295-834e-a74fa35f8c40 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:52.416224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9e629fe4-ed2a-4295-834e-a74fa35f8c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:52.439002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:52.547854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bda7c6-bbac-4447-bfb9-b8e343f02aed None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.548135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bda7c6-bbac-4447-bfb9-b8e343f02aed None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.550055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bda7c6-bbac-4447-bfb9-b8e343f02aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.645894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 810/1658] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:52.659928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f6a73-e126-4ab5-b5e4-25f6180bb307 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.660725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f6a73-e126-4ab5-b5e4-25f6180bb307 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.661347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f6a73-e126-4ab5-b5e4-25f6180bb307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.667245 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d6bda7c6-bbac-4447-bfb9-b8e343f02aed None None] MFA Rules not processed for user `512b9c6cf0d5458da0efff5b25c527c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:52.672363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d6bda7c6-bbac-4447-bfb9-b8e343f02aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:52.708751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:52.728114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-133f6a73-e126-4ab5-b5e4-25f6180bb307 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:52.729414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-133f6a73-e126-4ab5-b5e4-25f6180bb307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:52.775721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 811/1659] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:52.779946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f6a73-e126-4ab5-b5e4-25f6180bb307 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:52.798159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f6a73-e126-4ab5-b5e4-25f6180bb307 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:52.824497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90b6fb-deea-48f7-bcc0-a54de887ab60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:52.825726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90b6fb-deea-48f7-bcc0-a54de887ab60 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.826246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90b6fb-deea-48f7-bcc0-a54de887ab60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.826725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90b6fb-deea-48f7-bcc0-a54de887ab60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.834426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90b6fb-deea-48f7-bcc0-a54de887ab60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:42:52.835079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90b6fb-deea-48f7-bcc0-a54de887ab60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:52.837588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90b6fb-deea-48f7-bcc0-a54de887ab60 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:52.866037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 849/1660] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:52.872022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 812/1661] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:42:52.874912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bda7c6-bbac-4447-bfb9-b8e343f02aed None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:52.893473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bda7c6-bbac-4447-bfb9-b8e343f02aed None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:52.901700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd6892-a80b-4f4e-aa58-9c2c7ef130b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:52.904692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6892-a80b-4f4e-aa58-9c2c7ef130b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:52.905230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6892-a80b-4f4e-aa58-9c2c7ef130b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:52.905672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd6892-a80b-4f4e-aa58-9c2c7ef130b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:52.906731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd6892-a80b-4f4e-aa58-9c2c7ef130b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:52.909955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd6892-a80b-4f4e-aa58-9c2c7ef130b8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:52.984454 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 850/1662] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:52 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:52.985779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90b6fb-deea-48f7-bcc0-a54de887ab60 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:53.001314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90b6fb-deea-48f7-bcc0-a54de887ab60 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:53.167576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9d290-29a9-40fe-8c51-293ab7f8d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:53.172640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9d290-29a9-40fe-8c51-293ab7f8d165 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:53.173428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9d290-29a9-40fe-8c51-293ab7f8d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:53.174266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9d290-29a9-40fe-8c51-293ab7f8d165 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:53.176756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9d290-29a9-40fe-8c51-293ab7f8d165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:53.185740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab9d290-29a9-40fe-8c51-293ab7f8d165 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:53.255009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd6892-a80b-4f4e-aa58-9c2c7ef130b8 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:53.258204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 813/1663] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:52 2022] POST /identity/v3/users => generated 287 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:42:53.324572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd6892-a80b-4f4e-aa58-9c2c7ef130b8 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:53.365368 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0cd2-5b95-4607-9d3f-be5cf82ad224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:53.368702 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0cd2-5b95-4607-9d3f-be5cf82ad224 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:53.369238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0cd2-5b95-4607-9d3f-be5cf82ad224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:53.369751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0cd2-5b95-4607-9d3f-be5cf82ad224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:53.375741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca0cd2-5b95-4607-9d3f-be5cf82ad224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:53.377889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca0cd2-5b95-4607-9d3f-be5cf82ad224 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:53.412252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 851/1664] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:53.415849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9d290-29a9-40fe-8c51-293ab7f8d165 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:53.435993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab9d290-29a9-40fe-8c51-293ab7f8d165 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:53.442263 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45414b7-a1e6-41ea-bd62-05d392d8e772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:53.446396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45414b7-a1e6-41ea-bd62-05d392d8e772 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:53.446950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45414b7-a1e6-41ea-bd62-05d392d8e772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:53.447373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45414b7-a1e6-41ea-bd62-05d392d8e772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:53.448280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45414b7-a1e6-41ea-bd62-05d392d8e772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:53.450485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45414b7-a1e6-41ea-bd62-05d392d8e772 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:53.478658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0cd2-5b95-4607-9d3f-be5cf82ad224 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:53.490489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 814/1665] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:53.493152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0cd2-5b95-4607-9d3f-be5cf82ad224 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:53.504775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58e35b-e4ca-401a-858b-57882075f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:53.509279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58e35b-e4ca-401a-858b-57882075f026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:53.510284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58e35b-e4ca-401a-858b-57882075f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:53.510734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c58e35b-e4ca-401a-858b-57882075f026 admin admin] PATH_INFO: `/v3/projects/133a7651db144c468cde5fec709e5d12/users/4d4115760a104b6280957ef928b3cdac/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:53.542596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58e35b-e4ca-401a-858b-57882075f026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=133a7651db144c468cde5fec709e5d12, user_id=4d4115760a104b6280957ef928b3cdac, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:53.546071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c58e35b-e4ca-401a-858b-57882075f026 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:53.572155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 852/1666] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:53 2022] PUT /identity/v3/projects/133a7651db144c468cde5fec709e5d12/users/4d4115760a104b6280957ef928b3cdac/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:53.584971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515207-ce10-415a-b1b0-05d6122cd024 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:53.585270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515207-ce10-415a-b1b0-05d6122cd024 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:53.585558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb515207-ce10-415a-b1b0-05d6122cd024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:53.665047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-fb515207-ce10-415a-b1b0-05d6122cd024 None None] MFA Rules not processed for user `4d4115760a104b6280957ef928b3cdac`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:53.666322 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fb515207-ce10-415a-b1b0-05d6122cd024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:53.869596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 815/1667] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:53.871201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58e35b-e4ca-401a-858b-57882075f026 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:53.981638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c58e35b-e4ca-401a-858b-57882075f026 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:53.994232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bd80d-1d7e-4718-b14f-f0133e846e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:53.995096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bd80d-1d7e-4718-b14f-f0133e846e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:53.995810 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bd80d-1d7e-4718-b14f-f0133e846e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:54.002562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bd80d-1d7e-4718-b14f-f0133e846e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:54.004882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bd80d-1d7e-4718-b14f-f0133e846e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:54.011315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042bd80d-1d7e-4718-b14f-f0133e846e44 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:54.070945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 853/1668] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:42:53 2022] POST /identity/v3/projects => generated 373 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:54.075803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb515207-ce10-415a-b1b0-05d6122cd024 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:54.091896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:54.102879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb515207-ce10-415a-b1b0-05d6122cd024 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:54.326368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc4d75-a192-4237-a41f-e1eda4b26770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:54.327741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4d75-a192-4237-a41f-e1eda4b26770 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:54.328290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4d75-a192-4237-a41f-e1eda4b26770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:54.328665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4d75-a192-4237-a41f-e1eda4b26770 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:54.329498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc4d75-a192-4237-a41f-e1eda4b26770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:54.332225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc4d75-a192-4237-a41f-e1eda4b26770 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:54.366803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 816/1669] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:42:54 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:42:54.370941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bd80d-1d7e-4718-b14f-f0133e846e44 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:54.387179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bd80d-1d7e-4718-b14f-f0133e846e44 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:54.397545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e68e1-fa70-4a52-b6a8-482bae72f92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:54.398292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e68e1-fa70-4a52-b6a8-482bae72f92a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:54.398579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e68e1-fa70-4a52-b6a8-482bae72f92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:54.398858 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e68e1-fa70-4a52-b6a8-482bae72f92a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:54.399598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e68e1-fa70-4a52-b6a8-482bae72f92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:54.401401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e68e1-fa70-4a52-b6a8-482bae72f92a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:54.418159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 854/1670] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:42:54.431019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc4d75-a192-4237-a41f-e1eda4b26770 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:54.446980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc4d75-a192-4237-a41f-e1eda4b26770 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:54.454696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79be98-10b9-4255-88ca-1558fb337fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:54.455984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79be98-10b9-4255-88ca-1558fb337fdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:54.456439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79be98-10b9-4255-88ca-1558fb337fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:54.456857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79be98-10b9-4255-88ca-1558fb337fdc admin admin] PATH_INFO: `/v3/projects/1b8dff30fa0c46e38e7acbc2483db040/users/b03e29408b26447186ba2af1301816a4/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:54.497997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79be98-10b9-4255-88ca-1558fb337fdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8dff30fa0c46e38e7acbc2483db040, user_id=b03e29408b26447186ba2af1301816a4, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:54.501042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe79be98-10b9-4255-88ca-1558fb337fdc admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:54.521611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 817/1671] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:54 2022] PUT /identity/v3/projects/1b8dff30fa0c46e38e7acbc2483db040/users/b03e29408b26447186ba2af1301816a4/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:54.526190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e68e1-fa70-4a52-b6a8-482bae72f92a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:54.551409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e68e1-fa70-4a52-b6a8-482bae72f92a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:54.669973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:54.776288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9b81b-4acd-4c14-ae8c-6937f1279cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:54.777498 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b81b-4acd-4c14-ae8c-6937f1279cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:54.778281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b81b-4acd-4c14-ae8c-6937f1279cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:54.791890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9b81b-4acd-4c14-ae8c-6937f1279cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:54.793187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9b81b-4acd-4c14-ae8c-6937f1279cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:54.795802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9b81b-4acd-4c14-ae8c-6937f1279cb6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:54.844955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 855/1672] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:42:54 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:42:54.849502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79be98-10b9-4255-88ca-1558fb337fdc admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:54.860382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d35212-0dae-4b88-9697-059124961432 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:54.861972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d35212-0dae-4b88-9697-059124961432 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:54.862656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d35212-0dae-4b88-9697-059124961432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:54.875649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79be98-10b9-4255-88ca-1558fb337fdc admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:54.893699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d4343d-4194-400c-b62e-d4262036096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:54.894711 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4343d-4194-400c-b62e-d4262036096f admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:54.895004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4343d-4194-400c-b62e-d4262036096f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:54.895284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d4343d-4194-400c-b62e-d4262036096f admin admin] PATH_INFO: `/v3/projects/1b8dff30fa0c46e38e7acbc2483db040/users/b03e29408b26447186ba2af1301816a4/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:54.897165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-93d35212-0dae-4b88-9697-059124961432 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:54.898595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-93d35212-0dae-4b88-9697-059124961432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:54.907130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4343d-4194-400c-b62e-d4262036096f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b8dff30fa0c46e38e7acbc2483db040, user_id=b03e29408b26447186ba2af1301816a4, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:54.930602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d4343d-4194-400c-b62e-d4262036096f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:54.961368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 818/1673] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:42:54 2022] PUT /identity/v3/projects/1b8dff30fa0c46e38e7acbc2483db040/users/b03e29408b26447186ba2af1301816a4/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:54.971986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1033-036d-47f3-b0b9-fb02c9b03ae9 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:54.972602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1033-036d-47f3-b0b9-fb02c9b03ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:54.973183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85f1033-036d-47f3-b0b9-fb02c9b03ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.005405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 856/1674] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:42:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:55.064409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-b85f1033-036d-47f3-b0b9-fb02c9b03ae9 None None] MFA Rules not processed for user `b03e29408b26447186ba2af1301816a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:55.065947 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b85f1033-036d-47f3-b0b9-fb02c9b03ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:55.246210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 819/1675] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:42:55.261541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d35212-0dae-4b88-9697-059124961432 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:55.263376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-93d35212-0dae-4b88-9697-059124961432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:55.320846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f1033-036d-47f3-b0b9-fb02c9b03ae9 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:55.322621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b85f1033-036d-47f3-b0b9-fb02c9b03ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:55.463368 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d35212-0dae-4b88-9697-059124961432 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:55.541712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:55.570500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71babc8a-5ca2-4f8a-b039-a5fe564611cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:55.571315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babc8a-5ca2-4f8a-b039-a5fe564611cb service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.571649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babc8a-5ca2-4f8a-b039-a5fe564611cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.572629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71babc8a-5ca2-4f8a-b039-a5fe564611cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.615317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babc8a-5ca2-4f8a-b039-a5fe564611cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:55.624445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71babc8a-5ca2-4f8a-b039-a5fe564611cb service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:55.626446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85f1033-036d-47f3-b0b9-fb02c9b03ae9 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:55.652572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88ab51-f78b-45a6-bcf9-85d88230e21a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:55.653371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ab51-f78b-45a6-bcf9-85d88230e21a service swift] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.653535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 857/1676] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:55 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:55.653657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ab51-f78b-45a6-bcf9-85d88230e21a service swift] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.653982 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88ab51-f78b-45a6-bcf9-85d88230e21a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.885697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88ab51-f78b-45a6-bcf9-85d88230e21a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:55.888021 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88ab51-f78b-45a6-bcf9-85d88230e21a service swift] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:55.909755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 820/1677] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:42:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:42:55.965036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9a791-9ee7-402c-a605-1621be827e51 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:55.965336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9a791-9ee7-402c-a605-1621be827e51 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:55.965614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c9a791-9ee7-402c-a605-1621be827e51 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:55.968478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 858/1678] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:42:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:42:56.142675 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5471c0e-b20c-4bf1-b6fa-1555d3997fbf None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.142977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5471c0e-b20c-4bf1-b6fa-1555d3997fbf None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.143242 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5471c0e-b20c-4bf1-b6fa-1555d3997fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.220942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a5471c0e-b20c-4bf1-b6fa-1555d3997fbf None None] MFA Rules not processed for user `582296b1e43f4d12ab99eec9283b0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:56.226676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a5471c0e-b20c-4bf1-b6fa-1555d3997fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:56.449982 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 821/1679] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:56.549369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9cbe7-99b5-4176-b412-bb1124b90dcc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:56.550509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9cbe7-99b5-4176-b412-bb1124b90dcc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:56.551094 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9cbe7-99b5-4176-b412-bb1124b90dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:56.728750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-40d9cbe7-99b5-4176-b412-bb1124b90dcc None None] MFA Rules not processed for user `1102bd74633c42b6be5f419c16ba89cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:56.735424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-40d9cbe7-99b5-4176-b412-bb1124b90dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:56.862322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:57.005310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5471c0e-b20c-4bf1-b6fa-1555d3997fbf None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:57.006799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a5471c0e-b20c-4bf1-b6fa-1555d3997fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:57.037402 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5471c0e-b20c-4bf1-b6fa-1555d3997fbf None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:57.057743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d161f1a-6875-4071-921f-bfd762364799 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582296b1e43f4d12ab99eec9283b0d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:57.063622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d161f1a-6875-4071-921f-bfd762364799 service placement] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:57.066005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d161f1a-6875-4071-921f-bfd762364799 service placement] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:57.066963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d161f1a-6875-4071-921f-bfd762364799 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:57.116057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d161f1a-6875-4071-921f-bfd762364799 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:57.120458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d161f1a-6875-4071-921f-bfd762364799 service placement] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:57.146481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 859/1680] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:57.155946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9cbe7-99b5-4176-b412-bb1124b90dcc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:57.171600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 822/1681] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:57.187348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d161f1a-6875-4071-921f-bfd762364799 service placement] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:57.190805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5d161f1a-6875-4071-921f-bfd762364799 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:57.451663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9cbe7-99b5-4176-b412-bb1124b90dcc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:57.495808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:57.499378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:57.500269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:57.500710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:57.500854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] PATH_INFO: `/v3/users/4d4115760a104b6280957ef928b3cdac` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:57.520430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4115760a104b6280957ef928b3cdac)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:57.520430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:57.524226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d161f1a-6875-4071-921f-bfd762364799 service placement] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:57.542283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fb30e-533d-4e85-8062-e7783568e1dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:57.543350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fb30e-533d-4e85-8062-e7783568e1dd service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:57.543831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fb30e-533d-4e85-8062-e7783568e1dd service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:57.544293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fb30e-533d-4e85-8062-e7783568e1dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:57.569485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fb30e-533d-4e85-8062-e7783568e1dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:57.571596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fb30e-533d-4e85-8062-e7783568e1dd service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:57.600835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 823/1682] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:42:57.688107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4115760a104b6280957ef928b3cdac'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:57.737045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4115760a104b6280957ef928b3cdac'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:57.738017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4115760a104b6280957ef928b3cdac'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:57.816191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4115760a104b6280957ef928b3cdac'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:57.891189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4115760a104b6280957ef928b3cdac'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:42:57.940793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 860/1683] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:42:57 2022] DELETE /identity/v3/users/4d4115760a104b6280957ef928b3cdac => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:42:57.946307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf32bfa-fc59-48c8-81eb-5c60bc84ef04 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:57.946937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf32bfa-fc59-48c8-81eb-5c60bc84ef04 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:57.947436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf32bfa-fc59-48c8-81eb-5c60bc84ef04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:57.991526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1bf32bfa-fc59-48c8-81eb-5c60bc84ef04 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:42:57.994045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1bf32bfa-fc59-48c8-81eb-5c60bc84ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:58.217731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 824/1684] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:42:58.292223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:42:58.294322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:42:58.435605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:42:58.489361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f681a4-c32b-486b-9469-85feaa900da5 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:42:58.500546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8812371-80ff-4ba9-9989-8561f24a7f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:42:58.501226 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8812371-80ff-4ba9-9989-8561f24a7f77 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:42:58.501540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8812371-80ff-4ba9-9989-8561f24a7f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:42:58.501821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8812371-80ff-4ba9-9989-8561f24a7f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:42:58.567202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8812371-80ff-4ba9-9989-8561f24a7f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:42:58.568841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8812371-80ff-4ba9-9989-8561f24a7f77 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:42:58.609456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 861/1685] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:00.867915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bfcf7-fc1b-456c-8dd8-f8abd3e6b806 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:00.869067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bfcf7-fc1b-456c-8dd8-f8abd3e6b806 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:00.869487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bfcf7-fc1b-456c-8dd8-f8abd3e6b806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:00.955932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8812371-80ff-4ba9-9989-8561f24a7f77 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:00.957961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c8812371-80ff-4ba9-9989-8561f24a7f77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:01.034733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8812371-80ff-4ba9-9989-8561f24a7f77 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:01.055659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-392bfcf7-fc1b-456c-8dd8-f8abd3e6b806 None None] MFA Rules not processed for user `e26fe8b541484066a2b7c35cd20a4132`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:01.057019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-392bfcf7-fc1b-456c-8dd8-f8abd3e6b806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:01.063811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:01.065594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.068934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.070283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] PATH_INFO: `/v3/users/af290a0e2a7b4602a6d146226e0eb36d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.076251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af290a0e2a7b4602a6d146226e0eb36d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:01.081887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:01.316747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af290a0e2a7b4602a6d146226e0eb36d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:01.359618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af290a0e2a7b4602a6d146226e0eb36d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:01.360461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af290a0e2a7b4602a6d146226e0eb36d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:01.420342 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af290a0e2a7b4602a6d146226e0eb36d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:01.433934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 825/1686] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 567 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:01.446718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366efd0-292d-4d95-ac49-078da359de7f None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:01.447004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366efd0-292d-4d95-ac49-078da359de7f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:01.447326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366efd0-292d-4d95-ac49-078da359de7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:01.468714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af290a0e2a7b4602a6d146226e0eb36d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:01.495935 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 862/1687] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:00 2022] DELETE /identity/v3/users/af290a0e2a7b4602a6d146226e0eb36d => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:01.523293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9366efd0-292d-4d95-ac49-078da359de7f None None] MFA Rules not processed for user `e26fe8b541484066a2b7c35cd20a4132`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:01.530705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9366efd0-292d-4d95-ac49-078da359de7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:01.759171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 826/1688] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:01.788045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:01.789833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:02.103393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0cc3a3-6a2d-40d3-949c-452d588de707 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:02.131968 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ff01a-79c6-4343-8225-a51e204c0d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:02.132950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ff01a-79c6-4343-8225-a51e204c0d9f service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:02.133238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ff01a-79c6-4343-8225-a51e204c0d9f service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:02.133519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ff01a-79c6-4343-8225-a51e204c0d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:02.145310 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-445ff01a-79c6-4343-8225-a51e204c0d9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:02.190958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ff01a-79c6-4343-8225-a51e204c0d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:02.201604 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ff01a-79c6-4343-8225-a51e204c0d9f service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:02.255438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 863/1689] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:03.279062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366efd0-292d-4d95-ac49-078da359de7f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.280944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9366efd0-292d-4d95-ac49-078da359de7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:03.487113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.535770 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e800-88f6-4f28-89ae-7f3acf3ae923 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.536815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e800-88f6-4f28-89ae-7f3acf3ae923 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.537065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9839e800-88f6-4f28-89ae-7f3acf3ae923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.570407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9839e800-88f6-4f28-89ae-7f3acf3ae923 None None] MFA Rules not processed for user `e4270ab375e04196ad17f121f4175915`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:03.573121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9839e800-88f6-4f28-89ae-7f3acf3ae923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:03.662466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366efd0-292d-4d95-ac49-078da359de7f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.668975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:03.686600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:03.690652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:03.693782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:03.697391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] PATH_INFO: `/v3/projects/72bee817b43543dbbd33c66a1c3151f2` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:03.702683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bee817b43543dbbd33c66a1c3151f2)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:03.709810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: WARNING py.warnings [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 14:43:03.709810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: warnings.warn(msg) May 25 14:43:03.709810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: May 25 14:43:03.713060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 864/1690] 10.222.0.81 () {58 vars in 1015 bytes} [Wed May 25 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:03.715907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:03.916561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839e800-88f6-4f28-89ae-7f3acf3ae923 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:03.920255 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9839e800-88f6-4f28-89ae-7f3acf3ae923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:03.931916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bee817b43543dbbd33c66a1c3151f2', 'request_id': 'req-c13c6003-3cc6-4a08-9bc4-1402425913b7'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:03.957350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9839e800-88f6-4f28-89ae-7f3acf3ae923 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:03.959829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bee817b43543dbbd33c66a1c3151f2', 'request_id': 'req-c13c6003-3cc6-4a08-9bc4-1402425913b7'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.000031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bee817b43543dbbd33c66a1c3151f2', 'request_id': 'req-c13c6003-3cc6-4a08-9bc4-1402425913b7'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.054681 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] The token cache is being invalidate because project 72bee817b43543dbbd33c66a1c3151f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:04.054855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.059223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.061659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 827/1691] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:03 2022] DELETE /identity/v3/projects/72bee817b43543dbbd33c66a1c3151f2 => generated 0 bytes in 784 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:04.068038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:04.075652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:04.136860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a20dbae-731a-449d-ac3c-1b3aa55582b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.137546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20dbae-731a-449d-ac3c-1b3aa55582b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.137830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20dbae-731a-449d-ac3c-1b3aa55582b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.142602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a20dbae-731a-449d-ac3c-1b3aa55582b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.146468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8a20dbae-731a-449d-ac3c-1b3aa55582b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:04.184741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20dbae-731a-449d-ac3c-1b3aa55582b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.191944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a20dbae-731a-449d-ac3c-1b3aa55582b3 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.238173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 865/1692] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:04.297784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6003-3cc6-4a08-9bc4-1402425913b7 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:04.320300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:04.321812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.322373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.326282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] PATH_INFO: `/v3/users/512b9c6cf0d5458da0efff5b25c527c7` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.329466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] RBAC: Authorizing `identity:delete_user(user_id=512b9c6cf0d5458da0efff5b25c527c7)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:04.342882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:04.481630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '512b9c6cf0d5458da0efff5b25c527c7'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.482983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '512b9c6cf0d5458da0efff5b25c527c7'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.484750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '512b9c6cf0d5458da0efff5b25c527c7'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.523124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:04.540786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '512b9c6cf0d5458da0efff5b25c527c7'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.558838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d89bc0b-dc02-46b5-8fdc-5639368a845a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '512b9c6cf0d5458da0efff5b25c527c7'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:04.595525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 828/1693] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:04 2022] DELETE /identity/v3/users/512b9c6cf0d5458da0efff5b25c527c7 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:04.752205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510e4c9-677e-4ac0-b180-7109f5d9d8f3 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.752925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510e4c9-677e-4ac0-b180-7109f5d9d8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.752925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510e4c9-677e-4ac0-b180-7109f5d9d8f3 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.761111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e592de-62ae-4c12-b892-926833404d79 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:04.762510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e592de-62ae-4c12-b892-926833404d79 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:04.762913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e592de-62ae-4c12-b892-926833404d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:04.771938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 866/1694] 10.222.0.79 () {54 vars in 912 bytes} [Wed May 25 14:43:04 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:04.800569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d4e592de-62ae-4c12-b892-926833404d79 None None] MFA Rules not processed for user `e4270ab375e04196ad17f121f4175915`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:04.804824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d4e592de-62ae-4c12-b892-926833404d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:04.975927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 829/1695] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:43:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:05.005529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510e4c9-677e-4ac0-b180-7109f5d9d8f3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.011738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6510e4c9-677e-4ac0-b180-7109f5d9d8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:05.059964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510e4c9-677e-4ac0-b180-7109f5d9d8f3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.064746 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f5e73-c700-403a-9861-b96edf5b1f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.065603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5e73-c700-403a-9861-b96edf5b1f96 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.066038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5e73-c700-403a-9861-b96edf5b1f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.066510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48f5e73-c700-403a-9861-b96edf5b1f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.098573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f5e73-c700-403a-9861-b96edf5b1f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.104271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48f5e73-c700-403a-9861-b96edf5b1f96 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:05.139668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 867/1696] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:05.689317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e592de-62ae-4c12-b892-926833404d79 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.691133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d4e592de-62ae-4c12-b892-926833404d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:05.777898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f5e73-c700-403a-9861-b96edf5b1f96 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:05.785435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d48f5e73-c700-403a-9861-b96edf5b1f96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:05.923755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e592de-62ae-4c12-b892-926833404d79 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:05.949933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:05.951077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:05.951553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:05.951941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] PATH_INFO: `/v3/projects/1001c2ac80e2494296f741f8742f9403` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:05.953815 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1001c2ac80e2494296f741f8742f9403)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:05.960258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.126872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1001c2ac80e2494296f741f8742f9403', 'request_id': 'req-0094d9d7-b059-4d11-b8df-1502248c0f3f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:06.149513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1001c2ac80e2494296f741f8742f9403', 'request_id': 'req-0094d9d7-b059-4d11-b8df-1502248c0f3f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:06.201869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1001c2ac80e2494296f741f8742f9403', 'request_id': 'req-0094d9d7-b059-4d11-b8df-1502248c0f3f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:06.220011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] The token cache is being invalidate because project 1001c2ac80e2494296f741f8742f9403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:06.220481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:06.221495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0094d9d7-b059-4d11-b8df-1502248c0f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:06.225442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 830/1697] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:05 2022] DELETE /identity/v3/projects/1001c2ac80e2494296f741f8742f9403 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:06.227350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772e6a-c562-4646-b5c7-a2690b3c7dbf None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.227964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772e6a-c562-4646-b5c7-a2690b3c7dbf None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.228995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f772e6a-c562-4646-b5c7-a2690b3c7dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.289804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-2f772e6a-c562-4646-b5c7-a2690b3c7dbf None None] MFA Rules not processed for user `1102bd74633c42b6be5f419c16ba89cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:06.291165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-2f772e6a-c562-4646-b5c7-a2690b3c7dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:06.326996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:06.445577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 831/1698] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:06.447245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82f720-a582-4cb2-9b36-803bc36a56cc None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.447725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82f720-a582-4cb2-9b36-803bc36a56cc None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.448877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82f720-a582-4cb2-9b36-803bc36a56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.477095 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48f5e73-c700-403a-9861-b96edf5b1f96 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:06.497521 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-0e82f720-a582-4cb2-9b36-803bc36a56cc None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:06.498812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0e82f720-a582-4cb2-9b36-803bc36a56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:06.622223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:06.623301 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.624797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.627320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] PATH_INFO: `/v3/projects/133a7651db144c468cde5fec709e5d12` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.629131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=133a7651db144c468cde5fec709e5d12)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:06.635196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:06.697229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 832/1699] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:06.706824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93144e9d-1707-4e0a-a43b-ddbc19ffac9d None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:06.707188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93144e9d-1707-4e0a-a43b-ddbc19ffac9d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:06.707587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93144e9d-1707-4e0a-a43b-ddbc19ffac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:06.708836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:06.768338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133a7651db144c468cde5fec709e5d12', 'request_id': 'req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:06.799919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133a7651db144c468cde5fec709e5d12', 'request_id': 'req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:06.825350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133a7651db144c468cde5fec709e5d12', 'request_id': 'req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:06.869831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] The token cache is being invalidate because project 133a7651db144c468cde5fec709e5d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:06.877969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:06.879906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:06.883083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 868/1700] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:05 2022] DELETE /identity/v3/projects/133a7651db144c468cde5fec709e5d12 => generated 0 bytes in 1106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:06.888119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:06.893626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:06.913787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-93144e9d-1707-4e0a-a43b-ddbc19ffac9d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:06.915145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-93144e9d-1707-4e0a-a43b-ddbc19ffac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:07.018818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 833/1701] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:07.020624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93144e9d-1707-4e0a-a43b-ddbc19ffac9d None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.037874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93144e9d-1707-4e0a-a43b-ddbc19ffac9d None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.047311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92c142-a975-47c3-ae37-2d4e9b4e6037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.054124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92c142-a975-47c3-ae37-2d4e9b4e6037 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.054124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92c142-a975-47c3-ae37-2d4e9b4e6037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.054124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b92c142-a975-47c3-ae37-2d4e9b4e6037 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.054124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92c142-a975-47c3-ae37-2d4e9b4e6037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:07.054124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92c142-a975-47c3-ae37-2d4e9b4e6037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.055382 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b92c142-a975-47c3-ae37-2d4e9b4e6037 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.079515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 834/1702] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:07.085708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92c142-a975-47c3-ae37-2d4e9b4e6037 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.099198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b92c142-a975-47c3-ae37-2d4e9b4e6037 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.107712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e0e80-d227-4e92-b7c5-408b719e7600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.108557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0e80-d227-4e92-b7c5-408b719e7600 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.108951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0e80-d227-4e92-b7c5-408b719e7600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.109350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e0e80-d227-4e92-b7c5-408b719e7600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.109862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263f0a8-1ad6-4fc9-807f-dc2ecc70ec9d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.110334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e0e80-d227-4e92-b7c5-408b719e7600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.114294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e0e80-d227-4e92-b7c5-408b719e7600 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.132659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.133657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.134015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.134404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] PATH_INFO: `/v3/users/b03e29408b26447186ba2af1301816a4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.147298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b03e29408b26447186ba2af1301816a4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.150244 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.161287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 835/1703] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:07 2022] POST /identity/v3/projects => generated 369 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:07.162597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e0e80-d227-4e92-b7c5-408b719e7600 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.265135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:07.352195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b03e29408b26447186ba2af1301816a4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:07.372607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b03e29408b26447186ba2af1301816a4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:07.376962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b03e29408b26447186ba2af1301816a4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:07.429286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b03e29408b26447186ba2af1301816a4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:07.431244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e0e80-d227-4e92-b7c5-408b719e7600 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.449596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677cd2d-9057-4941-a621-29e84f8e7624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.452461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b03e29408b26447186ba2af1301816a4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:07.453120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677cd2d-9057-4941-a621-29e84f8e7624 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.453744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677cd2d-9057-4941-a621-29e84f8e7624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.454031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677cd2d-9057-4941-a621-29e84f8e7624 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.455443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677cd2d-9057-4941-a621-29e84f8e7624 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.465198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0677cd2d-9057-4941-a621-29e84f8e7624 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.481888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 869/1704] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:06 2022] DELETE /identity/v3/users/b03e29408b26447186ba2af1301816a4 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:07.543123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 836/1705] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:07 2022] POST /identity/v3/users => generated 285 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:07.548267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.549959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:07.710609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:07.789863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b7636-cbb5-48f0-9d99-a08cd32b8586 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.803536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9df00-a6ba-4ba7-aabe-3ad20258aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.805027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9df00-a6ba-4ba7-aabe-3ad20258aea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.807584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9df00-a6ba-4ba7-aabe-3ad20258aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.808106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d9df00-a6ba-4ba7-aabe-3ad20258aea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.809769 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9df00-a6ba-4ba7-aabe-3ad20258aea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.814183 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d9df00-a6ba-4ba7-aabe-3ad20258aea5 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.838913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 870/1706] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:07.852719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677cd2d-9057-4941-a621-29e84f8e7624 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.887708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0677cd2d-9057-4941-a621-29e84f8e7624 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:07.903928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe53467-1619-4bd5-a375-657addec69ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:07.910544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53467-1619-4bd5-a375-657addec69ac admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:07.910544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53467-1619-4bd5-a375-657addec69ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:07.910544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe53467-1619-4bd5-a375-657addec69ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:07.910544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53467-1619-4bd5-a375-657addec69ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:07.924559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe53467-1619-4bd5-a375-657addec69ac admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:07.967243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9df00-a6ba-4ba7-aabe-3ad20258aea5 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:07.985002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 837/1707] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:07.988751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d9df00-a6ba-4ba7-aabe-3ad20258aea5 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.008328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284eb5b-d443-4fc4-89ec-a031932af9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.014229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284eb5b-d443-4fc4-89ec-a031932af9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.028276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284eb5b-d443-4fc4-89ec-a031932af9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.031007 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284eb5b-d443-4fc4-89ec-a031932af9fa admin admin] PATH_INFO: `/v3/projects/66dc629d4da5430bb75e71c72dd5ba0b/users/4ab5d6be8ac34cc48e839bce41349b4c/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.097861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284eb5b-d443-4fc4-89ec-a031932af9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=66dc629d4da5430bb75e71c72dd5ba0b, user_id=4ab5d6be8ac34cc48e839bce41349b4c, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.100885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d284eb5b-d443-4fc4-89ec-a031932af9fa admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.145961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 871/1708] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:07 2022] PUT /identity/v3/projects/66dc629d4da5430bb75e71c72dd5ba0b/users/4ab5d6be8ac34cc48e839bce41349b4c/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:08.148098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac6a7c-099c-4c2d-bea8-6fe66d79cbfd None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.148754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac6a7c-099c-4c2d-bea8-6fe66d79cbfd None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.149113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac6a7c-099c-4c2d-bea8-6fe66d79cbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.223511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-65ac6a7c-099c-4c2d-bea8-6fe66d79cbfd None None] MFA Rules not processed for user `4ab5d6be8ac34cc48e839bce41349b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:08.226387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-65ac6a7c-099c-4c2d-bea8-6fe66d79cbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:08.278658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284eb5b-d443-4fc4-89ec-a031932af9fa admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.282595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d284eb5b-d443-4fc4-89ec-a031932af9fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:08.427964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 838/1709] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:08.430459 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac6a7c-099c-4c2d-bea8-6fe66d79cbfd None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.503965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d284eb5b-d443-4fc4-89ec-a031932af9fa admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.520365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.524594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.525083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.526169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] PATH_INFO: `/v3/projects/1b8dff30fa0c46e38e7acbc2483db040` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.528649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b8dff30fa0c46e38e7acbc2483db040)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.535330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.596352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac6a7c-099c-4c2d-bea8-6fe66d79cbfd None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.623906 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0293a4-43de-4865-a74e-d8c57f06bc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.624791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0293a4-43de-4865-a74e-d8c57f06bc16 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.625089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0293a4-43de-4865-a74e-d8c57f06bc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.625453 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0293a4-43de-4865-a74e-d8c57f06bc16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.626435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0293a4-43de-4865-a74e-d8c57f06bc16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.629703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0293a4-43de-4865-a74e-d8c57f06bc16 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.695630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 839/1710] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:08 2022] POST /identity/v3/projects => generated 367 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:08.700920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0293a4-43de-4865-a74e-d8c57f06bc16 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:08.714002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b8dff30fa0c46e38e7acbc2483db040', 'request_id': 'req-a8573e20-1d82-4725-b878-6ac728f1247d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:08.752597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b8dff30fa0c46e38e7acbc2483db040', 'request_id': 'req-a8573e20-1d82-4725-b878-6ac728f1247d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:08.759538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:08.787054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b8dff30fa0c46e38e7acbc2483db040', 'request_id': 'req-a8573e20-1d82-4725-b878-6ac728f1247d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:08.815196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] The token cache is being invalidate because project 1b8dff30fa0c46e38e7acbc2483db040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:08.816021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:08.821237 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a8573e20-1d82-4725-b878-6ac728f1247d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:08.823613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 872/1711] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:08 2022] DELETE /identity/v3/projects/1b8dff30fa0c46e38e7acbc2483db040 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:08.828545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39e98d-7b70-41c7-bfa9-997276504180 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.828898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39e98d-7b70-41c7-bfa9-997276504180 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.829719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39e98d-7b70-41c7-bfa9-997276504180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.902312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-be39e98d-7b70-41c7-bfa9-997276504180 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:08.903953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-be39e98d-7b70-41c7-bfa9-997276504180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:08.928169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 873/1712] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:08.937165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ad1ea-e820-4d00-85ac-d5c5d5561172 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.937441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ad1ea-e820-4d00-85ac-d5c5d5561172 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.937849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ad1ea-e820-4d00-85ac-d5c5d5561172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.940373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0293a4-43de-4865-a74e-d8c57f06bc16 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:08.945621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c63006-32dc-40da-a0af-f4e2b12fbc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:08.946349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c63006-32dc-40da-a0af-f4e2b12fbc59 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:08.946872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c63006-32dc-40da-a0af-f4e2b12fbc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:08.948337 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c63006-32dc-40da-a0af-f4e2b12fbc59 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:08.949471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c63006-32dc-40da-a0af-f4e2b12fbc59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:08.952818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c63006-32dc-40da-a0af-f4e2b12fbc59 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:08.987255 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 840/1713] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:08 2022] POST /identity/v3/users => generated 290 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:08.993062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c63006-32dc-40da-a0af-f4e2b12fbc59 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.003306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-49c63006-32dc-40da-a0af-f4e2b12fbc59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:09.005549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d33ad1ea-e820-4d00-85ac-d5c5d5561172 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:09.006879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d33ad1ea-e820-4d00-85ac-d5c5d5561172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:09.022292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c63006-32dc-40da-a0af-f4e2b12fbc59 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.032034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38976f-639e-45fa-b6f0-a70e199d759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.033616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38976f-639e-45fa-b6f0-a70e199d759e admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.034911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38976f-639e-45fa-b6f0-a70e199d759e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.035244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38976f-639e-45fa-b6f0-a70e199d759e admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.036714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38976f-639e-45fa-b6f0-a70e199d759e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.038810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38976f-639e-45fa-b6f0-a70e199d759e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.050469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 874/1714] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:09.054537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ad1ea-e820-4d00-85ac-d5c5d5561172 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.060909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 841/1715] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:09.066884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38976f-639e-45fa-b6f0-a70e199d759e admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.073057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ad1ea-e820-4d00-85ac-d5c5d5561172 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.089842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38976f-639e-45fa-b6f0-a70e199d759e admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.091288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5ed7-f2f4-4ece-968c-ffeb6860169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.091523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5ed7-f2f4-4ece-968c-ffeb6860169d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.091980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5ed7-f2f4-4ece-968c-ffeb6860169d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.092084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e5ed7-f2f4-4ece-968c-ffeb6860169d admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.092801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e5ed7-f2f4-4ece-968c-ffeb6860169d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:09.093110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e5ed7-f2f4-4ece-968c-ffeb6860169d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.095007 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e5ed7-f2f4-4ece-968c-ffeb6860169d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.102282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa3af2-b6d3-4de6-9a02-8fd191fb0747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.106391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3af2-b6d3-4de6-9a02-8fd191fb0747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.106712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3af2-b6d3-4de6-9a02-8fd191fb0747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.106949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aa3af2-b6d3-4de6-9a02-8fd191fb0747 admin admin] PATH_INFO: `/v3/projects/32c1b50779b04887ae0fc6c2d0d78d19/users/5dbbfbe42faa4ab0b93f271c5cfd48aa/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.129285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 875/1716] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:09.135317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5ed7-f2f4-4ece-968c-ffeb6860169d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.151722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa3af2-b6d3-4de6-9a02-8fd191fb0747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c1b50779b04887ae0fc6c2d0d78d19, user_id=5dbbfbe42faa4ab0b93f271c5cfd48aa, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.154610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aa3af2-b6d3-4de6-9a02-8fd191fb0747 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.161798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.174844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e5ed7-f2f4-4ece-968c-ffeb6860169d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.189426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a174e6f-9338-464b-962d-ba7f2da77f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.190422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a174e6f-9338-464b-962d-ba7f2da77f4e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.190734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a174e6f-9338-464b-962d-ba7f2da77f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.191401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a174e6f-9338-464b-962d-ba7f2da77f4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.192083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a174e6f-9338-464b-962d-ba7f2da77f4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.193883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a174e6f-9338-464b-962d-ba7f2da77f4e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.234069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 842/1717] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:09 2022] PUT /identity/v3/projects/32c1b50779b04887ae0fc6c2d0d78d19/users/5dbbfbe42faa4ab0b93f271c5cfd48aa/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:09.235816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa3af2-b6d3-4de6-9a02-8fd191fb0747 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.425386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 876/1718] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:09 2022] POST /identity/v3/projects => generated 385 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:09.427835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a174e6f-9338-464b-962d-ba7f2da77f4e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.440548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aa3af2-b6d3-4de6-9a02-8fd191fb0747 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.527692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a174e6f-9338-464b-962d-ba7f2da77f4e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.534754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023cfc0-28f2-4fc0-b14f-f93ffe3f71db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.535497 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023cfc0-28f2-4fc0-b14f-f93ffe3f71db admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.535863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023cfc0-28f2-4fc0-b14f-f93ffe3f71db admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.536280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023cfc0-28f2-4fc0-b14f-f93ffe3f71db admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.537741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023cfc0-28f2-4fc0-b14f-f93ffe3f71db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.540812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023cfc0-28f2-4fc0-b14f-f93ffe3f71db admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.599087 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 877/1719] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:09 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:09.601739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023cfc0-28f2-4fc0-b14f-f93ffe3f71db admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.610869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326bd53-4118-4dda-8f8b-c8dc97687175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.613191 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326bd53-4118-4dda-8f8b-c8dc97687175 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.613489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326bd53-4118-4dda-8f8b-c8dc97687175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.613941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326bd53-4118-4dda-8f8b-c8dc97687175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.614627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326bd53-4118-4dda-8f8b-c8dc97687175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.618364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326bd53-4118-4dda-8f8b-c8dc97687175 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.649219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023cfc0-28f2-4fc0-b14f-f93ffe3f71db admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.654856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 843/1720] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:09.661412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326bd53-4118-4dda-8f8b-c8dc97687175 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.668096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3fe1f-d8ab-4799-8cfc-256fa1df64ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.669045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3fe1f-d8ab-4799-8cfc-256fa1df64ae admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.680674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3fe1f-d8ab-4799-8cfc-256fa1df64ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.681797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3fe1f-d8ab-4799-8cfc-256fa1df64ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.683135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3fe1f-d8ab-4799-8cfc-256fa1df64ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.685722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326bd53-4118-4dda-8f8b-c8dc97687175 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.695057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3fe1f-d8ab-4799-8cfc-256fa1df64ae admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.723406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2160ad-6419-4420-9779-8bdde2e82e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:09.724781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2160ad-6419-4420-9779-8bdde2e82e12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.725223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2160ad-6419-4420-9779-8bdde2e82e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.725794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2160ad-6419-4420-9779-8bdde2e82e12 admin admin] PATH_INFO: `/v3/projects/32c1b50779b04887ae0fc6c2d0d78d19/users/5dbbfbe42faa4ab0b93f271c5cfd48aa/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.736819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2160ad-6419-4420-9779-8bdde2e82e12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32c1b50779b04887ae0fc6c2d0d78d19, user_id=5dbbfbe42faa4ab0b93f271c5cfd48aa, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:09.740040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2160ad-6419-4420-9779-8bdde2e82e12 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:09.746279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 878/1721] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:09.755468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3fe1f-d8ab-4799-8cfc-256fa1df64ae admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:09.786194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 844/1722] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:09 2022] PUT /identity/v3/projects/32c1b50779b04887ae0fc6c2d0d78d19/users/5dbbfbe42faa4ab0b93f271c5cfd48aa/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:09.798404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80175d73-08df-4d4f-acc9-87675847d601 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:09.798725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80175d73-08df-4d4f-acc9-87675847d601 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:09.799457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80175d73-08df-4d4f-acc9-87675847d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:09.807225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3fe1f-d8ab-4799-8cfc-256fa1df64ae admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:09.829625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:09.948655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-80175d73-08df-4d4f-acc9-87675847d601 None None] MFA Rules not processed for user `5dbbfbe42faa4ab0b93f271c5cfd48aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:09.950769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-80175d73-08df-4d4f-acc9-87675847d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:10.133423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e973f-7f4f-4059-bac8-98a7403b0863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.134200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e973f-7f4f-4059-bac8-98a7403b0863 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.134536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e973f-7f4f-4059-bac8-98a7403b0863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.134800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e973f-7f4f-4059-bac8-98a7403b0863 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.136201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e973f-7f4f-4059-bac8-98a7403b0863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.154656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e973f-7f4f-4059-bac8-98a7403b0863 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.236787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 879/1723] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:09 2022] GET /identity/v3/roles => generated 1420 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:10.244188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e973f-7f4f-4059-bac8-98a7403b0863 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.310633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e973f-7f4f-4059-bac8-98a7403b0863 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.331038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6790b-3287-492a-9143-7521eb4089af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.332777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6790b-3287-492a-9143-7521eb4089af admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.336712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6790b-3287-492a-9143-7521eb4089af admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.338502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6790b-3287-492a-9143-7521eb4089af admin admin] PATH_INFO: `/v3/projects/0f0db12f613b442c95645fddff771f02/users/c6186a365bd2460d86f6474b749a2d3a/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.394940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 845/1724] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 598 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:10.413998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80175d73-08df-4d4f-acc9-87675847d601 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.416593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-80175d73-08df-4d4f-acc9-87675847d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:10.444634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6790b-3287-492a-9143-7521eb4089af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0db12f613b442c95645fddff771f02, user_id=c6186a365bd2460d86f6474b749a2d3a, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.452423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca6790b-3287-492a-9143-7521eb4089af admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.510638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 880/1725] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:10 2022] PUT /identity/v3/projects/0f0db12f613b442c95645fddff771f02/users/c6186a365bd2460d86f6474b749a2d3a/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:10.526297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89170cd3-38c8-49a3-9f92-a8f3dd4256b0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.526633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89170cd3-38c8-49a3-9f92-a8f3dd4256b0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.526917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89170cd3-38c8-49a3-9f92-a8f3dd4256b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.590386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80175d73-08df-4d4f-acc9-87675847d601 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:10.627154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-89170cd3-38c8-49a3-9f92-a8f3dd4256b0 None None] MFA Rules not processed for user `c6186a365bd2460d86f6474b749a2d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:10.631854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-89170cd3-38c8-49a3-9f92-a8f3dd4256b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:10.660754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739ba87e-e1f4-4d88-947a-d227ad1b9738 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:10.661548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ba87e-e1f4-4d88-947a-d227ad1b9738 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.662025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ba87e-e1f4-4d88-947a-d227ad1b9738 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.662482 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ba87e-e1f4-4d88-947a-d227ad1b9738 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:10.700266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.840730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:10.842013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 881/1726] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:10.850008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89170cd3-38c8-49a3-9f92-a8f3dd4256b0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:10.852905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ba87e-e1f4-4d88-947a-d227ad1b9738 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:10.862643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739ba87e-e1f4-4d88-947a-d227ad1b9738 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:10.945085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 846/1727] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:10.952023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8614577-1d02-4403-b321-564b9b4d168e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:10.952827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8614577-1d02-4403-b321-564b9b4d168e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:10.952827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8614577-1d02-4403-b321-564b9b4d168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.022509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89170cd3-38c8-49a3-9f92-a8f3dd4256b0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.022764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e8614577-1d02-4403-b321-564b9b4d168e None None] MFA Rules not processed for user `e26fe8b541484066a2b7c35cd20a4132`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:11.026360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e8614577-1d02-4403-b321-564b9b4d168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:11.030773 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f683edd-b1d7-41b7-b8b7-19c109c651ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.031754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683edd-b1d7-41b7-b8b7-19c109c651ee admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.032265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683edd-b1d7-41b7-b8b7-19c109c651ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.032701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f683edd-b1d7-41b7-b8b7-19c109c651ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.033618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f683edd-b1d7-41b7-b8b7-19c109c651ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.036285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f683edd-b1d7-41b7-b8b7-19c109c651ee admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.089048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 882/1728] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:10 2022] POST /identity/v3/projects => generated 385 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:11.093590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f683edd-b1d7-41b7-b8b7-19c109c651ee admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.186127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 847/1729] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:11.279835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f683edd-b1d7-41b7-b8b7-19c109c651ee admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.287321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17f4c6-6d4e-42da-9608-b49cddafb815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.288949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f4c6-6d4e-42da-9608-b49cddafb815 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.289874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f4c6-6d4e-42da-9608-b49cddafb815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.290686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17f4c6-6d4e-42da-9608-b49cddafb815 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.293088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17f4c6-6d4e-42da-9608-b49cddafb815 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.297088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b17f4c6-6d4e-42da-9608-b49cddafb815 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.336544 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 883/1730] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:11 2022] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:11.337671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8614577-1d02-4403-b321-564b9b4d168e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.362891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8614577-1d02-4403-b321-564b9b4d168e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.381270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d71b3-a596-40a2-9f4c-e0fd1d010e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.382642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d71b3-a596-40a2-9f4c-e0fd1d010e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.383080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d71b3-a596-40a2-9f4c-e0fd1d010e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.383652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d71b3-a596-40a2-9f4c-e0fd1d010e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.384347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d71b3-a596-40a2-9f4c-e0fd1d010e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.389186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d71b3-a596-40a2-9f4c-e0fd1d010e0d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.412769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 848/1731] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:11.414296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17f4c6-6d4e-42da-9608-b49cddafb815 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.433010 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17f4c6-6d4e-42da-9608-b49cddafb815 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.448367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef0173-b1e6-42f0-9916-9570afb74fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.450254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef0173-b1e6-42f0-9916-9570afb74fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.450951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef0173-b1e6-42f0-9916-9570afb74fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.451770 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef0173-b1e6-42f0-9916-9570afb74fa8 admin admin] PATH_INFO: `/v3/projects/7955d1b5c8c145d5aa1eff95e1f6c2a2/users/27177f99a4fc43de8d83634abb04470c/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.481182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef0173-b1e6-42f0-9916-9570afb74fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7955d1b5c8c145d5aa1eff95e1f6c2a2, user_id=27177f99a4fc43de8d83634abb04470c, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.485968 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef0173-b1e6-42f0-9916-9570afb74fa8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.509957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 884/1732] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:11 2022] PUT /identity/v3/projects/7955d1b5c8c145d5aa1eff95e1f6c2a2/users/27177f99a4fc43de8d83634abb04470c/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:11.515006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d71b3-a596-40a2-9f4c-e0fd1d010e0d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.535592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d71b3-a596-40a2-9f4c-e0fd1d010e0d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.654982 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceba61a-be70-4a68-852c-6ef89db2dc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.656385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceba61a-be70-4a68-852c-6ef89db2dc4b admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.657927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceba61a-be70-4a68-852c-6ef89db2dc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.660752 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceba61a-be70-4a68-852c-6ef89db2dc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.662227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceba61a-be70-4a68-852c-6ef89db2dc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.668735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceba61a-be70-4a68-852c-6ef89db2dc4b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.698223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1d6b-db8d-43f2-a762-fa125bf46252 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.698721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1d6b-db8d-43f2-a762-fa125bf46252 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.700457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e1d6b-db8d-43f2-a762-fa125bf46252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.736538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 849/1733] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:11.740224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceba61a-be70-4a68-852c-6ef89db2dc4b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:11.777206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:11.781280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceba61a-be70-4a68-852c-6ef89db2dc4b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:11.792270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0c5e1d6b-db8d-43f2-a762-fa125bf46252 None None] MFA Rules not processed for user `4e2fc01480c04ff2988700d0474adebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:11.794468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0c5e1d6b-db8d-43f2-a762-fa125bf46252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:11.807277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d71108-1817-4367-96b8-6b058f5914e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:11.818005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71108-1817-4367-96b8-6b058f5914e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.818005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71108-1817-4367-96b8-6b058f5914e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.818005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d71108-1817-4367-96b8-6b058f5914e9 admin admin] PATH_INFO: `/v3/projects/7955d1b5c8c145d5aa1eff95e1f6c2a2/users/27177f99a4fc43de8d83634abb04470c/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:11.821590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d71108-1817-4367-96b8-6b058f5914e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7955d1b5c8c145d5aa1eff95e1f6c2a2, user_id=27177f99a4fc43de8d83634abb04470c, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:11.843946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d71108-1817-4367-96b8-6b058f5914e9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:11.938477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 850/1734] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:11 2022] PUT /identity/v3/projects/7955d1b5c8c145d5aa1eff95e1f6c2a2/users/27177f99a4fc43de8d83634abb04470c/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:11.944416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969574c8-0c8d-4cd1-b56e-0cb30b332a67 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:11.944793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969574c8-0c8d-4cd1-b56e-0cb30b332a67 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:11.945310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969574c8-0c8d-4cd1-b56e-0cb30b332a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.108541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-969574c8-0c8d-4cd1-b56e-0cb30b332a67 None None] MFA Rules not processed for user `27177f99a4fc43de8d83634abb04470c`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:12.113606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-969574c8-0c8d-4cd1-b56e-0cb30b332a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:12.193005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 885/1735] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:12.310035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:12.331488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 851/1736] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:11 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:12.436465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e1d6b-db8d-43f2-a762-fa125bf46252 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:12.669304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e1d6b-db8d-43f2-a762-fa125bf46252 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:12.770018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b2f44-0a85-4712-8307-b05e9d4afc99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:12.771149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b2f44-0a85-4712-8307-b05e9d4afc99 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:12.771910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b2f44-0a85-4712-8307-b05e9d4afc99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:12.772589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b2f44-0a85-4712-8307-b05e9d4afc99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:12.794017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b2f44-0a85-4712-8307-b05e9d4afc99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:12.797896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b2f44-0a85-4712-8307-b05e9d4afc99 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:12.832225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 886/1737] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:12.894360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969574c8-0c8d-4cd1-b56e-0cb30b332a67 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.095512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969574c8-0c8d-4cd1-b56e-0cb30b332a67 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.111409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.113033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.118269 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.119986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] PATH_INFO: `/v3/users/c6186a365bd2460d86f6474b749a2d3a` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.122526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6186a365bd2460d86f6474b749a2d3a)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.127656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:13.246707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6186a365bd2460d86f6474b749a2d3a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.250761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6186a365bd2460d86f6474b749a2d3a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.252057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6186a365bd2460d86f6474b749a2d3a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.267944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6186a365bd2460d86f6474b749a2d3a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.277033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6186a365bd2460d86f6474b749a2d3a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:13.297080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 852/1738] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:12 2022] DELETE /identity/v3/users/c6186a365bd2460d86f6474b749a2d3a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:13.304514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8753e-9615-494a-a539-a10d62d5bb63 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.310372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8753e-9615-494a-a539-a10d62d5bb63 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.312482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa8753e-9615-494a-a539-a10d62d5bb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.403687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-baa8753e-9615-494a-a539-a10d62d5bb63 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:13.408048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-baa8753e-9615-494a-a539-a10d62d5bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:13.628440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 887/1739] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:13.732456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:13.734822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:13.910762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48450342-97a0-4da9-bc66-7273f7e65bed admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:13.921375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba1a6-10da-404d-94a1-6d4d9819193e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:13.923162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba1a6-10da-404d-94a1-6d4d9819193e service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:13.924536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba1a6-10da-404d-94a1-6d4d9819193e service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:13.925090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eba1a6-10da-404d-94a1-6d4d9819193e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:13.947109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eba1a6-10da-404d-94a1-6d4d9819193e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:13.952434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eba1a6-10da-404d-94a1-6d4d9819193e service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.000188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 853/1740] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:14.549582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8753e-9615-494a-a539-a10d62d5bb63 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.551409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-baa8753e-9615-494a-a539-a10d62d5bb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:14.560442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.697804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba1a6-10da-404d-94a1-6d4d9819193e service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:14.700156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-47eba1a6-10da-404d-94a1-6d4d9819193e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:14.732180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eba1a6-10da-404d-94a1-6d4d9819193e service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.748469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.752082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.752365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.752644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] PATH_INFO: `/v3/users/4ab5d6be8ac34cc48e839bce41349b4c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.757852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ab5d6be8ac34cc48e839bce41349b4c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:14.762685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:14.785669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa8753e-9615-494a-a539-a10d62d5bb63 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:14.797172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33158c-da75-421f-98b0-8b6f6cefcde3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:14.798748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33158c-da75-421f-98b0-8b6f6cefcde3 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:14.799312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33158c-da75-421f-98b0-8b6f6cefcde3 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:14.799801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33158c-da75-421f-98b0-8b6f6cefcde3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:14.806122 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2f33158c-da75-421f-98b0-8b6f6cefcde3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:14.808927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:14.907619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ab5d6be8ac34cc48e839bce41349b4c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:14.909757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ab5d6be8ac34cc48e839bce41349b4c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:14.911867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ab5d6be8ac34cc48e839bce41349b4c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:14.941509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ab5d6be8ac34cc48e839bce41349b4c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:14.956638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e1eed370-d2ec-4e05-9cf0-d261e2a78b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ab5d6be8ac34cc48e839bce41349b4c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:15.012171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 854/1741] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:14 2022] DELETE /identity/v3/users/4ab5d6be8ac34cc48e839bce41349b4c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:15.014456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdd5b8-859d-4433-b31e-205c1e4364ae None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.016011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdd5b8-859d-4433-b31e-205c1e4364ae None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.017189 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdd5b8-859d-4433-b31e-205c1e4364ae None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.024274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 855/1742] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:43:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:15.028805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d197-d1d1-4dbb-8232-82cfcb5ae6a7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.030785 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d197-d1d1-4dbb-8232-82cfcb5ae6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.032283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62d197-d1d1-4dbb-8232-82cfcb5ae6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.041001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33158c-da75-421f-98b0-8b6f6cefcde3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.049334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33158c-da75-421f-98b0-8b6f6cefcde3 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.079428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 888/1743] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:15.080228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9f62d197-d1d1-4dbb-8232-82cfcb5ae6a7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:15.081599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9f62d197-d1d1-4dbb-8232-82cfcb5ae6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:15.126439 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ae978-6133-40ff-8998-3669098d912c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.126904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ae978-6133-40ff-8998-3669098d912c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.127291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087ae978-6133-40ff-8998-3669098d912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.186313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-087ae978-6133-40ff-8998-3669098d912c None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:15.191838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-087ae978-6133-40ff-8998-3669098d912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:15.271573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 856/1744] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:15.421162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 889/1745] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:43:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:15.554736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d197-d1d1-4dbb-8232-82cfcb5ae6a7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:15.556387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9f62d197-d1d1-4dbb-8232-82cfcb5ae6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:15.725413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62d197-d1d1-4dbb-8232-82cfcb5ae6a7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:15.736911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25713133-980c-40c2-88ec-30abf3dca83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:15.737871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25713133-980c-40c2-88ec-30abf3dca83f service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:15.738420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25713133-980c-40c2-88ec-30abf3dca83f service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:15.738835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25713133-980c-40c2-88ec-30abf3dca83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:15.763040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25713133-980c-40c2-88ec-30abf3dca83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:15.764681 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25713133-980c-40c2-88ec-30abf3dca83f service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:15.798569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 857/1746] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:16.103063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ae978-6133-40ff-8998-3669098d912c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.105682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-087ae978-6133-40ff-8998-3669098d912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:16.129243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087ae978-6133-40ff-8998-3669098d912c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.138305 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.139196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.139479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.139755 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] PATH_INFO: `/v3/projects/0f0db12f613b442c95645fddff771f02` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.149130 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0db12f613b442c95645fddff771f02)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.165749 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.214757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.237891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0db12f613b442c95645fddff771f02', 'request_id': 'req-beb04567-df79-43e8-a926-c4edca3b8f02'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.253831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0db12f613b442c95645fddff771f02', 'request_id': 'req-beb04567-df79-43e8-a926-c4edca3b8f02'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.263381 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0db12f613b442c95645fddff771f02', 'request_id': 'req-beb04567-df79-43e8-a926-c4edca3b8f02'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.306633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] The token cache is being invalidate because project 0f0db12f613b442c95645fddff771f02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:16.306995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.310027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.314451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 890/1747] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:16 2022] DELETE /identity/v3/projects/0f0db12f613b442c95645fddff771f02 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:16.318461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25713133-980c-40c2-88ec-30abf3dca83f service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.332460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25713133-980c-40c2-88ec-30abf3dca83f service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:16.421390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:16.497583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:16.498583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:16.508807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:16.508807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] PATH_INFO: `/v3/users/27177f99a4fc43de8d83634abb04470c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:16.508807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27177f99a4fc43de8d83634abb04470c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:16.513075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:16.660959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27177f99a4fc43de8d83634abb04470c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.662409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:16.663989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:16.669840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27177f99a4fc43de8d83634abb04470c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.675251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27177f99a4fc43de8d83634abb04470c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.733483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27177f99a4fc43de8d83634abb04470c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.770761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27177f99a4fc43de8d83634abb04470c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:16.815532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 858/1748] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:16 2022] DELETE /identity/v3/users/27177f99a4fc43de8d83634abb04470c => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:16.930964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb04567-df79-43e8-a926-c4edca3b8f02 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:17.135537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0ab29-b561-40e6-b5ee-36612bb91d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:17.136408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0ab29-b561-40e6-b5ee-36612bb91d2d service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:17.136796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0ab29-b561-40e6-b5ee-36612bb91d2d service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:17.137175 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc0ab29-b561-40e6-b5ee-36612bb91d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:17.140887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ccc0ab29-b561-40e6-b5ee-36612bb91d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:17.171930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0ab29-b561-40e6-b5ee-36612bb91d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:17.176711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc0ab29-b561-40e6-b5ee-36612bb91d2d service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:17.220879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 891/1749] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:18.585836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.595092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:18.789014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119bf25-7538-42d9-bdde-75adced076a1 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.794986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:18.796793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:18.797279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:18.797835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] PATH_INFO: `/v3/projects/7955d1b5c8c145d5aa1eff95e1f6c2a2` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:18.799518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7955d1b5c8c145d5aa1eff95e1f6c2a2)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:18.802060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:18.934533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0ab29-b561-40e6-b5ee-36612bb91d2d service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:18.935375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7955d1b5c8c145d5aa1eff95e1f6c2a2', 'request_id': 'req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:18.936016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ccc0ab29-b561-40e6-b5ee-36612bb91d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:18.964280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc0ab29-b561-40e6-b5ee-36612bb91d2d service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:18.975331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7955d1b5c8c145d5aa1eff95e1f6c2a2', 'request_id': 'req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:18.987641 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:18.997324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7955d1b5c8c145d5aa1eff95e1f6c2a2', 'request_id': 'req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.033328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] The token cache is being invalidate because project 7955d1b5c8c145d5aa1eff95e1f6c2a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:19.033609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.035735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-db9ce912-f9eb-4671-8f7f-1bf046e54bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.037721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 859/1750] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:18 2022] DELETE /identity/v3/projects/7955d1b5c8c145d5aa1eff95e1f6c2a2 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:19.039232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c626f-198c-4c3e-bcbb-6258cc997514 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.039714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c626f-198c-4c3e-bcbb-6258cc997514 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.040541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72c626f-198c-4c3e-bcbb-6258cc997514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.067883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.090454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e72c626f-198c-4c3e-bcbb-6258cc997514 None None] MFA Rules not processed for user `43fc4ad124f943c086954c28a0a6e199`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:19.093753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e72c626f-198c-4c3e-bcbb-6258cc997514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:19.136052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.137279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.137692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.138055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] PATH_INFO: `/v3/projects/66dc629d4da5430bb75e71c72dd5ba0b` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.140759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66dc629d4da5430bb75e71c72dd5ba0b)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.147038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.243738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 860/1751] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:19.245750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050d6aa-3522-45ac-b1ee-00cd4d246a5d None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.246585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050d6aa-3522-45ac-b1ee-00cd4d246a5d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.246974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050d6aa-3522-45ac-b1ee-00cd4d246a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.247837 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66dc629d4da5430bb75e71c72dd5ba0b', 'request_id': 'req-0569a75d-1759-49be-b6d8-b87b62a6f4eb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.271883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66dc629d4da5430bb75e71c72dd5ba0b', 'request_id': 'req-0569a75d-1759-49be-b6d8-b87b62a6f4eb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.281500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66dc629d4da5430bb75e71c72dd5ba0b', 'request_id': 'req-0569a75d-1759-49be-b6d8-b87b62a6f4eb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.283339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-3050d6aa-3522-45ac-b1ee-00cd4d246a5d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:19.285911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3050d6aa-3522-45ac-b1ee-00cd4d246a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:19.296335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] The token cache is being invalidate because project 66dc629d4da5430bb75e71c72dd5ba0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:19.298254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.298625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.301028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 892/1752] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:18 2022] DELETE /identity/v3/projects/66dc629d4da5430bb75e71c72dd5ba0b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:19.301981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.303487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:19.422628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569a75d-1759-49be-b6d8-b87b62a6f4eb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.424547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 861/1753] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:19.425853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050d6aa-3522-45ac-b1ee-00cd4d246a5d None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.427257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3050d6aa-3522-45ac-b1ee-00cd4d246a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:19.441384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050d6aa-3522-45ac-b1ee-00cd4d246a5d None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.445182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534dbfb6-0d11-4e64-a1f5-ac958b5a0690 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.445861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dbfb6-0d11-4e64-a1f5-ac958b5a0690 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.446190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dbfb6-0d11-4e64-a1f5-ac958b5a0690 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.446801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534dbfb6-0d11-4e64-a1f5-ac958b5a0690 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.450372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-534dbfb6-0d11-4e64-a1f5-ac958b5a0690 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:19.453364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.456713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.456713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.456713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] PATH_INFO: `/v3/users/5dbbfbe42faa4ab0b93f271c5cfd48aa` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.457507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dbbfbe42faa4ab0b93f271c5cfd48aa)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.461807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.523197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534dbfb6-0d11-4e64-a1f5-ac958b5a0690 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.524857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534dbfb6-0d11-4e64-a1f5-ac958b5a0690 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.536987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 893/1754] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:19.538624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5943c-1836-4961-bd8b-2f092ad7d9a0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.538919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5943c-1836-4961-bd8b-2f092ad7d9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.539200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5943c-1836-4961-bd8b-2f092ad7d9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.556336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.567513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dbbfbe42faa4ab0b93f271c5cfd48aa'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.568328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dbbfbe42faa4ab0b93f271c5cfd48aa'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.569093 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dbbfbe42faa4ab0b93f271c5cfd48aa'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.585520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f7f5943c-1836-4961-bd8b-2f092ad7d9a0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:19.587337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f7f5943c-1836-4961-bd8b-2f092ad7d9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:19.588230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dbbfbe42faa4ab0b93f271c5cfd48aa'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.593397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:19.599606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 894/1755] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:19.601271 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dbbfbe42faa4ab0b93f271c5cfd48aa'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:19.608872 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5943c-1836-4961-bd8b-2f092ad7d9a0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.622204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5943c-1836-4961-bd8b-2f092ad7d9a0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.628310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 862/1756] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:19 2022] DELETE /identity/v3/users/5dbbfbe42faa4ab0b93f271c5cfd48aa => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:19.630031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66925c1d-7e68-4ef9-93fc-d5ff1cb237cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.631122 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66925c1d-7e68-4ef9-93fc-d5ff1cb237cd admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.632239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66925c1d-7e68-4ef9-93fc-d5ff1cb237cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.632239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66925c1d-7e68-4ef9-93fc-d5ff1cb237cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.632775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66925c1d-7e68-4ef9-93fc-d5ff1cb237cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:19.633195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66925c1d-7e68-4ef9-93fc-d5ff1cb237cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.636678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66925c1d-7e68-4ef9-93fc-d5ff1cb237cd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.663475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 895/1757] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:19.668667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.772980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f2f06f-2958-44bf-aaea-d493c98f600c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:19.778803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c59f28-7d96-4063-971f-66b3124ee799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:19.780008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59f28-7d96-4063-971f-66b3124ee799 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:19.780667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59f28-7d96-4063-971f-66b3124ee799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:19.781076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c59f28-7d96-4063-971f-66b3124ee799 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:19.782861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c59f28-7d96-4063-971f-66b3124ee799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:19.785291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c59f28-7d96-4063-971f-66b3124ee799 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:19.845576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 863/1758] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:19 2022] POST /identity/v3/projects => generated 387 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:19.849728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66925c1d-7e68-4ef9-93fc-d5ff1cb237cd admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:19.880133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66925c1d-7e68-4ef9-93fc-d5ff1cb237cd admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.011309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1b366-214c-4370-a3cd-d555a48bf7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.012996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1b366-214c-4370-a3cd-d555a48bf7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.013836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1b366-214c-4370-a3cd-d555a48bf7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.014396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1b366-214c-4370-a3cd-d555a48bf7a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.015693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1b366-214c-4370-a3cd-d555a48bf7a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.020837 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1b366-214c-4370-a3cd-d555a48bf7a9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.080285 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca282-f3c1-401d-8e71-b0f7515c71c5 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.080575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca282-f3c1-401d-8e71-b0f7515c71c5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.080854 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cca282-f3c1-401d-8e71-b0f7515c71c5 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.088046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 864/1759] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:43:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 14:43:20.089011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cca282-f3c1-401d-8e71-b0f7515c71c5 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.094480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 896/1760] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:19 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:20.113300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cca282-f3c1-401d-8e71-b0f7515c71c5 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.137061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3513f6-ce06-437d-a6db-e05e46f364b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.137969 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3513f6-ce06-437d-a6db-e05e46f364b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.138519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3513f6-ce06-437d-a6db-e05e46f364b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.140657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3513f6-ce06-437d-a6db-e05e46f364b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.142341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3513f6-ce06-437d-a6db-e05e46f364b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.147275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3513f6-ce06-437d-a6db-e05e46f364b0 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.205136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 865/1761] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:20.210243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1b366-214c-4370-a3cd-d555a48bf7a9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.231269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1b366-214c-4370-a3cd-d555a48bf7a9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.233504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f3c7-fec7-454b-968a-3cfccab6d6f7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.233794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f3c7-fec7-454b-968a-3cfccab6d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.234120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522f3c7-fec7-454b-968a-3cfccab6d6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.247222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7c999-a606-4280-9e32-72c560e92536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.252188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7c999-a606-4280-9e32-72c560e92536 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.252468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7c999-a606-4280-9e32-72c560e92536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.254513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7c999-a606-4280-9e32-72c560e92536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.259706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7c999-a606-4280-9e32-72c560e92536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.274568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7c999-a606-4280-9e32-72c560e92536 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.285185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-3522f3c7-fec7-454b-968a-3cfccab6d6f7 None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:20.287576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3522f3c7-fec7-454b-968a-3cfccab6d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:20.295482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 897/1762] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:20.298722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7c999-a606-4280-9e32-72c560e92536 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.352568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7c999-a606-4280-9e32-72c560e92536 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.371909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5147f44-56b4-4243-a979-d69dc5b6b4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.371909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5147f44-56b4-4243-a979-d69dc5b6b4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.371909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5147f44-56b4-4243-a979-d69dc5b6b4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.371909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5147f44-56b4-4243-a979-d69dc5b6b4fb admin admin] PATH_INFO: `/v3/projects/331dc1e4b4414fb29cb21c8e5cb9bfbe/users/8801c7c8951943798bc49737a6cbe248/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.431580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5147f44-56b4-4243-a979-d69dc5b6b4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=331dc1e4b4414fb29cb21c8e5cb9bfbe, user_id=8801c7c8951943798bc49737a6cbe248, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:20.433627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5147f44-56b4-4243-a979-d69dc5b6b4fb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:20.466242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 898/1763] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:20 2022] PUT /identity/v3/projects/331dc1e4b4414fb29cb21c8e5cb9bfbe/users/8801c7c8951943798bc49737a6cbe248/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:20.477386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279863e-247b-4921-82aa-813f85c9f001 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:20.477827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279863e-247b-4921-82aa-813f85c9f001 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:20.478242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279863e-247b-4921-82aa-813f85c9f001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:20.535416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9279863e-247b-4921-82aa-813f85c9f001 None None] MFA Rules not processed for user `8801c7c8951943798bc49737a6cbe248`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:20.536469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9279863e-247b-4921-82aa-813f85c9f001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:20.587375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 866/1764] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:43:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:20.748910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 899/1765] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:20.755795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522f3c7-fec7-454b-968a-3cfccab6d6f7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.775170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522f3c7-fec7-454b-968a-3cfccab6d6f7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:20.954109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:20.996499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279863e-247b-4921-82aa-813f85c9f001 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:20.998245 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9279863e-247b-4921-82aa-813f85c9f001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:20.999045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f52c74-03f0-4b56-9587-7d02158806df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:20.999884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f52c74-03f0-4b56-9587-7d02158806df admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.000329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f52c74-03f0-4b56-9587-7d02158806df admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.001319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f52c74-03f0-4b56-9587-7d02158806df admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.002311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f52c74-03f0-4b56-9587-7d02158806df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.005034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f52c74-03f0-4b56-9587-7d02158806df admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.076689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 867/1766] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:20 2022] POST /identity/v3/projects => generated 387 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:21.078401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f52c74-03f0-4b56-9587-7d02158806df admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.096239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:21.244371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279863e-247b-4921-82aa-813f85c9f001 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.248509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f52c74-03f0-4b56-9587-7d02158806df admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.261100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96175ec-e609-40ff-b07a-3b3e51220c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.261794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96175ec-e609-40ff-b07a-3b3e51220c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.262582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96175ec-e609-40ff-b07a-3b3e51220c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.262582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96175ec-e609-40ff-b07a-3b3e51220c25 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.263513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96175ec-e609-40ff-b07a-3b3e51220c25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.268179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96175ec-e609-40ff-b07a-3b3e51220c25 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.327546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 868/1767] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:21 2022] POST /identity/v3/users => generated 300 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:21.329509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96175ec-e609-40ff-b07a-3b3e51220c25 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.355396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96175ec-e609-40ff-b07a-3b3e51220c25 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.368489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83c07-dca8-4145-a413-846bd327cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.369254 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83c07-dca8-4145-a413-846bd327cdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.369543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83c07-dca8-4145-a413-846bd327cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.370457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f83c07-dca8-4145-a413-846bd327cdb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.370716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f83c07-dca8-4145-a413-846bd327cdb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.372720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f83c07-dca8-4145-a413-846bd327cdb4 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.413286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 869/1768] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:21.424437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83c07-dca8-4145-a413-846bd327cdb4 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.430009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f296bd-4746-419d-98b4-a0ee96cec57c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.430733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f296bd-4746-419d-98b4-a0ee96cec57c service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.431014 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f296bd-4746-419d-98b4-a0ee96cec57c service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.431293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f296bd-4746-419d-98b4-a0ee96cec57c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.453387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f83c07-dca8-4145-a413-846bd327cdb4 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.458198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f296bd-4746-419d-98b4-a0ee96cec57c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.459656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f8288-cc08-4b59-93dc-4f5d00bfeb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.459892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f296bd-4746-419d-98b4-a0ee96cec57c service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.461192 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8288-cc08-4b59-93dc-4f5d00bfeb37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.461721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8288-cc08-4b59-93dc-4f5d00bfeb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.462536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8f8288-cc08-4b59-93dc-4f5d00bfeb37 admin admin] PATH_INFO: `/v3/projects/3eebe49b54d34842b5d6f9150bbadea7/users/95ffd230c09242d08da5c9a405513d65/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.489098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f8288-cc08-4b59-93dc-4f5d00bfeb37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eebe49b54d34842b5d6f9150bbadea7, user_id=95ffd230c09242d08da5c9a405513d65, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.492265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 900/1769] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:21.496802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8f8288-cc08-4b59-93dc-4f5d00bfeb37 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.553199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 870/1770] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:21 2022] PUT /identity/v3/projects/3eebe49b54d34842b5d6f9150bbadea7/users/95ffd230c09242d08da5c9a405513d65/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:21.558950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f296bd-4746-419d-98b4-a0ee96cec57c service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.582569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f296bd-4746-419d-98b4-a0ee96cec57c service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.670774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9e4359-5203-4aa0-892b-2cd9456fe007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.673432 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4359-5203-4aa0-892b-2cd9456fe007 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.674200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4359-5203-4aa0-892b-2cd9456fe007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.675722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9e4359-5203-4aa0-892b-2cd9456fe007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.678730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e4359-5203-4aa0-892b-2cd9456fe007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.696765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9e4359-5203-4aa0-892b-2cd9456fe007 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.734466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 901/1771] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:21.738607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f8288-cc08-4b59-93dc-4f5d00bfeb37 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:21.758060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8f8288-cc08-4b59-93dc-4f5d00bfeb37 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:21.770610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b9b1-9dd9-4f05-bde2-9a0bc14351f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:21.775781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b9b1-9dd9-4f05-bde2-9a0bc14351f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.776209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b9b1-9dd9-4f05-bde2-9a0bc14351f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.776597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508b9b1-9dd9-4f05-bde2-9a0bc14351f8 admin admin] PATH_INFO: `/v3/projects/3eebe49b54d34842b5d6f9150bbadea7/users/95ffd230c09242d08da5c9a405513d65/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.778992 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508b9b1-9dd9-4f05-bde2-9a0bc14351f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3eebe49b54d34842b5d6f9150bbadea7, user_id=95ffd230c09242d08da5c9a405513d65, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:21.788295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508b9b1-9dd9-4f05-bde2-9a0bc14351f8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:21.805970 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 871/1772] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:21 2022] PUT /identity/v3/projects/3eebe49b54d34842b5d6f9150bbadea7/users/95ffd230c09242d08da5c9a405513d65/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:21.818887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54fb6-cb4a-47f3-9ab9-5cccff76d5e3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:21.819180 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54fb6-cb4a-47f3-9ab9-5cccff76d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:21.819463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d54fb6-cb4a-47f3-9ab9-5cccff76d5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:21.880705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f7d54fb6-cb4a-47f3-9ab9-5cccff76d5e3 None None] MFA Rules not processed for user `95ffd230c09242d08da5c9a405513d65`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:21.882255 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f7d54fb6-cb4a-47f3-9ab9-5cccff76d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:21.949741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:22.057350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 902/1773] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:21 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:22.073372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b9b1-9dd9-4f05-bde2-9a0bc14351f8 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:22.079891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0508b9b1-9dd9-4f05-bde2-9a0bc14351f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:22.208705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508b9b1-9dd9-4f05-bde2-9a0bc14351f8 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:22.214697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41706e49-8d3b-4953-bfcf-77fde791a416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:22.216549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41706e49-8d3b-4953-bfcf-77fde791a416 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.216871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41706e49-8d3b-4953-bfcf-77fde791a416 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.217153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41706e49-8d3b-4953-bfcf-77fde791a416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.232938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41706e49-8d3b-4953-bfcf-77fde791a416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:22.240531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54fb6-cb4a-47f3-9ab9-5cccff76d5e3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:22.242913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f7d54fb6-cb4a-47f3-9ab9-5cccff76d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:22.265918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41706e49-8d3b-4953-bfcf-77fde791a416 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:22.297057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 872/1774] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:22.479724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d54fb6-cb4a-47f3-9ab9-5cccff76d5e3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:22.486992 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:22.488857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.489285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.489830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] PATH_INFO: `/v3/projects/32c1b50779b04887ae0fc6c2d0d78d19` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.491935 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] RBAC: Authorizing `identity:delete_project(project_id=32c1b50779b04887ae0fc6c2d0d78d19)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:22.494853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:22.649299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32c1b50779b04887ae0fc6c2d0d78d19', 'request_id': 'req-ba3a9f94-bba1-4b43-b213-99832c74beef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:22.665272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32c1b50779b04887ae0fc6c2d0d78d19', 'request_id': 'req-ba3a9f94-bba1-4b43-b213-99832c74beef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:22.677245 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32c1b50779b04887ae0fc6c2d0d78d19', 'request_id': 'req-ba3a9f94-bba1-4b43-b213-99832c74beef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:22.701957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] The token cache is being invalidate because project 32c1b50779b04887ae0fc6c2d0d78d19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:22.702317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:22.703415 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ba3a9f94-bba1-4b43-b213-99832c74beef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:22.714553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b291318-6403-4772-8383-ee6e8f08d9ee None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:22.714848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b291318-6403-4772-8383-ee6e8f08d9ee None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:22.715136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b291318-6403-4772-8383-ee6e8f08d9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:22.746684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 903/1775] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:22 2022] DELETE /identity/v3/projects/32c1b50779b04887ae0fc6c2d0d78d19 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:22.801702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-8b291318-6403-4772-8383-ee6e8f08d9ee None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:22.807033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8b291318-6403-4772-8383-ee6e8f08d9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:22.890601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:23.070628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 873/1776] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:23.078432 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a37bba-37f9-4651-b001-ae4a6cd2be7b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.078768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a37bba-37f9-4651-b001-ae4a6cd2be7b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.079048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a37bba-37f9-4651-b001-ae4a6cd2be7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.117121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-71a37bba-37f9-4651-b001-ae4a6cd2be7b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:23.118403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-71a37bba-37f9-4651-b001-ae4a6cd2be7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:23.140917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 904/1777] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:23.145831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b291318-6403-4772-8383-ee6e8f08d9ee None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.167258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b291318-6403-4772-8383-ee6e8f08d9ee None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.185885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8dbdc-a17a-4969-b496-00c8fc7d9d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.187615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8dbdc-a17a-4969-b496-00c8fc7d9d0e admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.187615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8dbdc-a17a-4969-b496-00c8fc7d9d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.187615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a8dbdc-a17a-4969-b496-00c8fc7d9d0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.188469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8dbdc-a17a-4969-b496-00c8fc7d9d0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:23.188902 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8dbdc-a17a-4969-b496-00c8fc7d9d0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.190751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a8dbdc-a17a-4969-b496-00c8fc7d9d0e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.220529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 874/1778] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:23.225233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a37bba-37f9-4651-b001-ae4a6cd2be7b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.237864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a37bba-37f9-4651-b001-ae4a6cd2be7b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.257793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4456bf4-3e6d-42eb-b962-f440624601b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.258612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4456bf4-3e6d-42eb-b962-f440624601b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.258930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4456bf4-3e6d-42eb-b962-f440624601b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.259292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4456bf4-3e6d-42eb-b962-f440624601b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.260080 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4456bf4-3e6d-42eb-b962-f440624601b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.262245 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4456bf4-3e6d-42eb-b962-f440624601b7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.332167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 905/1779] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:23 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:23.336195 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8dbdc-a17a-4969-b496-00c8fc7d9d0e admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.352638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a8dbdc-a17a-4969-b496-00c8fc7d9d0e admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.536818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8a647-8571-4a79-a4e4-f61a67d8d54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.541543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8a647-8571-4a79-a4e4-f61a67d8d54a admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.542293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8a647-8571-4a79-a4e4-f61a67d8d54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.542848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8a647-8571-4a79-a4e4-f61a67d8d54a admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.544196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8a647-8571-4a79-a4e4-f61a67d8d54a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.550569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8a647-8571-4a79-a4e4-f61a67d8d54a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.586859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 875/1780] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:23 2022] POST /identity/v3/users => generated 284 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:23.591060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4456bf4-3e6d-42eb-b962-f440624601b7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.615575 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4456bf4-3e6d-42eb-b962-f440624601b7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.634376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad488-c4a4-43e2-af38-50b8d9dc2b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.635159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad488-c4a4-43e2-af38-50b8d9dc2b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.637698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad488-c4a4-43e2-af38-50b8d9dc2b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.650270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ad488-c4a4-43e2-af38-50b8d9dc2b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.663981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ad488-c4a4-43e2-af38-50b8d9dc2b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.675037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ad488-c4a4-43e2-af38-50b8d9dc2b05 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.712185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 906/1781] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:43:23.717641 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8a647-8571-4a79-a4e4-f61a67d8d54a admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.758331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8a647-8571-4a79-a4e4-f61a67d8d54a admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.775342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b26e5c-ca21-49c9-8b89-8ccaefd4f81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.776419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b26e5c-ca21-49c9-8b89-8ccaefd4f81c admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.776813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b26e5c-ca21-49c9-8b89-8ccaefd4f81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.777199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b26e5c-ca21-49c9-8b89-8ccaefd4f81c admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.779107 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b26e5c-ca21-49c9-8b89-8ccaefd4f81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.784184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b26e5c-ca21-49c9-8b89-8ccaefd4f81c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.804153 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad488-c4a4-43e2-af38-50b8d9dc2b05 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.806110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3a5ad488-c4a4-43e2-af38-50b8d9dc2b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:23.824131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 876/1782] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:23.829186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b26e5c-ca21-49c9-8b89-8ccaefd4f81c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.831853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ad488-c4a4-43e2-af38-50b8d9dc2b05 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.842426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.843329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.843613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.843889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] PATH_INFO: `/v3/users/8801c7c8951943798bc49737a6cbe248` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.854281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8801c7c8951943798bc49737a6cbe248)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.856304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.874732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b26e5c-ca21-49c9-8b89-8ccaefd4f81c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:23.885609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936e86e-8f0d-4ec0-8163-ccbf7c58b3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:23.887962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936e86e-8f0d-4ec0-8163-ccbf7c58b3c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:23.888926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936e86e-8f0d-4ec0-8163-ccbf7c58b3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:23.889666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936e86e-8f0d-4ec0-8163-ccbf7c58b3c9 admin admin] PATH_INFO: `/v3/projects/a42ced1a309b45168bb1e60506aea18f/users/b92111350e7a4d338b63fc7bcf497615/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:23.926420 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:23.932808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936e86e-8f0d-4ec0-8163-ccbf7c58b3c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42ced1a309b45168bb1e60506aea18f, user_id=b92111350e7a4d338b63fc7bcf497615, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:23.937253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936e86e-8f0d-4ec0-8163-ccbf7c58b3c9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:23.985991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 877/1783] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:23 2022] PUT /identity/v3/projects/a42ced1a309b45168bb1e60506aea18f/users/b92111350e7a4d338b63fc7bcf497615/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:23.987832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936e86e-8f0d-4ec0-8163-ccbf7c58b3c9 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:23.993131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c936e86e-8f0d-4ec0-8163-ccbf7c58b3c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:23.993786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8801c7c8951943798bc49737a6cbe248'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:24.018654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8801c7c8951943798bc49737a6cbe248'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:24.020447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8801c7c8951943798bc49737a6cbe248'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:24.037880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8801c7c8951943798bc49737a6cbe248'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:24.048459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c929fd5f-c53c-4cd8-a9a5-39a1eaff13b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8801c7c8951943798bc49737a6cbe248'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:24.056451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 907/1784] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:23 2022] DELETE /identity/v3/users/8801c7c8951943798bc49737a6cbe248 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:24.058172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441fb1-0a03-44d1-8988-5f44f80f3b5b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.058517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441fb1-0a03-44d1-8988-5f44f80f3b5b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.059140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71441fb1-0a03-44d1-8988-5f44f80f3b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.125849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936e86e-8f0d-4ec0-8163-ccbf7c58b3c9 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.127632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-71441fb1-0a03-44d1-8988-5f44f80f3b5b None None] MFA Rules not processed for user `b92111350e7a4d338b63fc7bcf497615`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:24.129918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-71441fb1-0a03-44d1-8988-5f44f80f3b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:24.136755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:24.228676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.230508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.231264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.231521 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] PATH_INFO: `/v3/users/ae07dc573937439b8e3bf4f3e8b5774c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.233484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae07dc573937439b8e3bf4f3e8b5774c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.240806 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:24.268106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 908/1785] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:24.269701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4bfc2-72af-4f04-bbab-84588531ebf5 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.270354 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4bfc2-72af-4f04-bbab-84588531ebf5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.270796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec4bfc2-72af-4f04-bbab-84588531ebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.314478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0ec4bfc2-72af-4f04-bbab-84588531ebf5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:24.315753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0ec4bfc2-72af-4f04-bbab-84588531ebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:24.323768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae07dc573937439b8e3bf4f3e8b5774c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:24.324771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae07dc573937439b8e3bf4f3e8b5774c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:24.325614 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae07dc573937439b8e3bf4f3e8b5774c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:24.331121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 909/1786] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:24.332397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4bfc2-72af-4f04-bbab-84588531ebf5 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.342114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0ec4bfc2-72af-4f04-bbab-84588531ebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:24.348528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae07dc573937439b8e3bf4f3e8b5774c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:24.362375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae07dc573937439b8e3bf4f3e8b5774c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:24.369193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec4bfc2-72af-4f04-bbab-84588531ebf5 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.384131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 878/1787] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:23 2022] DELETE /identity/v3/users/ae07dc573937439b8e3bf4f3e8b5774c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:24.384131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.385928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:24.395222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2518669-6a34-46c1-9ca5-935f2e369951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.396722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2518669-6a34-46c1-9ca5-935f2e369951 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.397154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2518669-6a34-46c1-9ca5-935f2e369951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.397573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2518669-6a34-46c1-9ca5-935f2e369951 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.398691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2518669-6a34-46c1-9ca5-935f2e369951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.402024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2518669-6a34-46c1-9ca5-935f2e369951 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:24.513202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069713cb-ad62-4707-a8e0-5e5825cafda8 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.521056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b6506-32f3-43fc-97ad-96c037c433d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.522270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6506-32f3-43fc-97ad-96c037c433d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.522705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6506-32f3-43fc-97ad-96c037c433d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.523117 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6506-32f3-43fc-97ad-96c037c433d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.528431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 910/1788] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:24 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:24.528431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da03ac-7ecb-45ff-86f3-6282aeaeb0e2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.528788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da03ac-7ecb-45ff-86f3-6282aeaeb0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.532396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da03ac-7ecb-45ff-86f3-6282aeaeb0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.560699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-31da03ac-7ecb-45ff-86f3-6282aeaeb0e2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:24.562812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-31da03ac-7ecb-45ff-86f3-6282aeaeb0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:24.673504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:24.714827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:24.720584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b6506-32f3-43fc-97ad-96c037c433d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.722138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b6506-32f3-43fc-97ad-96c037c433d0 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:24.738515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 911/1789] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:24.747185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da03ac-7ecb-45ff-86f3-6282aeaeb0e2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.747411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 879/1790] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:24.760959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da03ac-7ecb-45ff-86f3-6282aeaeb0e2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.769484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da296011-389f-4e73-b6df-d6d0a9295818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.770945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da296011-389f-4e73-b6df-d6d0a9295818 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.771397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da296011-389f-4e73-b6df-d6d0a9295818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.771924 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da296011-389f-4e73-b6df-d6d0a9295818 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.773143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da296011-389f-4e73-b6df-d6d0a9295818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.775712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da296011-389f-4e73-b6df-d6d0a9295818 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:24.780499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b6506-32f3-43fc-97ad-96c037c433d0 service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.784325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c50b6506-32f3-43fc-97ad-96c037c433d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:24.808449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 912/1791] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:24 2022] POST /identity/v3/users => generated 290 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:24.812772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da296011-389f-4e73-b6df-d6d0a9295818 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.817247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b6506-32f3-43fc-97ad-96c037c433d0 service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.857819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da296011-389f-4e73-b6df-d6d0a9295818 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.867694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c292d-4762-431f-9905-932c0020ea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.869176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c292d-4762-431f-9905-932c0020ea6a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.869901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c292d-4762-431f-9905-932c0020ea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.870637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c292d-4762-431f-9905-932c0020ea6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.872469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c292d-4762-431f-9905-932c0020ea6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.876291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c292d-4762-431f-9905-932c0020ea6a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:24.903735 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 913/1792] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:24.905113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c292d-4762-431f-9905-932c0020ea6a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:24.914968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17007a10-19fd-448d-8bb8-35d186978b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.915876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007a10-19fd-448d-8bb8-35d186978b27 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.916264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007a10-19fd-448d-8bb8-35d186978b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.916745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17007a10-19fd-448d-8bb8-35d186978b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.924088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c292d-4762-431f-9905-932c0020ea6a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:24.930342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007a10-19fd-448d-8bb8-35d186978b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.932153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17007a10-19fd-448d-8bb8-35d186978b27 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:24.935626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62062-b3e2-4bb9-bb13-b8e515173a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:24.936471 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62062-b3e2-4bb9-bb13-b8e515173a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:24.936759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62062-b3e2-4bb9-bb13-b8e515173a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:24.937041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62062-b3e2-4bb9-bb13-b8e515173a6a admin admin] PATH_INFO: `/v3/projects/0700c955b266469e94fd525900301d67/users/418757ea228843668d63ea74a80096b4/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:24.956603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 880/1793] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:24.971204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62062-b3e2-4bb9-bb13-b8e515173a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0700c955b266469e94fd525900301d67, user_id=418757ea228843668d63ea74a80096b4, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:24.975126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62062-b3e2-4bb9-bb13-b8e515173a6a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.008961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17007a10-19fd-448d-8bb8-35d186978b27 service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.009530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 914/1794] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:24 2022] PUT /identity/v3/projects/0700c955b266469e94fd525900301d67/users/418757ea228843668d63ea74a80096b4/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:25.023340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17007a10-19fd-448d-8bb8-35d186978b27 service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.107378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b887e31-aed1-4391-a609-a4fe4bad420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.108726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b887e31-aed1-4391-a609-a4fe4bad420d admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.109029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b887e31-aed1-4391-a609-a4fe4bad420d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.109314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b887e31-aed1-4391-a609-a4fe4bad420d admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.112926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b887e31-aed1-4391-a609-a4fe4bad420d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:25.115823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b887e31-aed1-4391-a609-a4fe4bad420d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.142145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 881/1795] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:25.146431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62062-b3e2-4bb9-bb13-b8e515173a6a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.161219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62062-b3e2-4bb9-bb13-b8e515173a6a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.173838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa5a23-a44a-4ac5-9a01-ec2420a2575b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.175597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5a23-a44a-4ac5-9a01-ec2420a2575b admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.176122 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5a23-a44a-4ac5-9a01-ec2420a2575b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.176969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa5a23-a44a-4ac5-9a01-ec2420a2575b admin admin] PATH_INFO: `/v3/projects/0700c955b266469e94fd525900301d67/users/418757ea228843668d63ea74a80096b4/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.181782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa5a23-a44a-4ac5-9a01-ec2420a2575b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0700c955b266469e94fd525900301d67, user_id=418757ea228843668d63ea74a80096b4, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:25.189765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa5a23-a44a-4ac5-9a01-ec2420a2575b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.218731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 915/1796] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:25 2022] PUT /identity/v3/projects/0700c955b266469e94fd525900301d67/users/418757ea228843668d63ea74a80096b4/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:25.230347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4c8ca-c38a-4909-9536-9c717d8cbd5b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.230675 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4c8ca-c38a-4909-9536-9c717d8cbd5b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.230961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e4c8ca-c38a-4909-9536-9c717d8cbd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.274677 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d0e4c8ca-c38a-4909-9536-9c717d8cbd5b None None] MFA Rules not processed for user `418757ea228843668d63ea74a80096b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:25.277805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d0e4c8ca-c38a-4909-9536-9c717d8cbd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:25.344960 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78db59-32dc-43e5-8d16-bb2724747d5b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.345427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78db59-32dc-43e5-8d16-bb2724747d5b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.345574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78db59-32dc-43e5-8d16-bb2724747d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.381741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-fd78db59-32dc-43e5-8d16-bb2724747d5b None None] MFA Rules not processed for user `4e2fc01480c04ff2988700d0474adebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:25.385123 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fd78db59-32dc-43e5-8d16-bb2724747d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:25.430178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 882/1797] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:25.439853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4c8ca-c38a-4909-9536-9c717d8cbd5b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.442007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d0e4c8ca-c38a-4909-9536-9c717d8cbd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:25.456635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:25.550733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 916/1798] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:25.599001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e4c8ca-c38a-4909-9536-9c717d8cbd5b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.609049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ececd65-eab2-4d3b-86cb-dd8c6e3f4540 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.611833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ececd65-eab2-4d3b-86cb-dd8c6e3f4540 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.612648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ececd65-eab2-4d3b-86cb-dd8c6e3f4540 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.613091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ececd65-eab2-4d3b-86cb-dd8c6e3f4540 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.639374 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ececd65-eab2-4d3b-86cb-dd8c6e3f4540 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:25.648464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ececd65-eab2-4d3b-86cb-dd8c6e3f4540 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:25.666341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 883/1799] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:25 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:25.741621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78db59-32dc-43e5-8d16-bb2724747d5b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:25.745334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fd78db59-32dc-43e5-8d16-bb2724747d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:25.785361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78db59-32dc-43e5-8d16-bb2724747d5b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:25.796626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf154-26f2-4466-940c-ca4abce97171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:25.797848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf154-26f2-4466-940c-ca4abce97171 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.800021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf154-26f2-4466-940c-ca4abce97171 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.800659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbccf154-26f2-4466-940c-ca4abce97171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.808317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cbccf154-26f2-4466-940c-ca4abce97171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:25.846612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284fdc5-f44e-44fd-9830-ad304ae6040a None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.846612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284fdc5-f44e-44fd-9830-ad304ae6040a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.846612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c284fdc5-f44e-44fd-9830-ad304ae6040a None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.847126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 884/1800] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:43:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:43:25.863653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffacf0-07b2-4614-94a4-b9015c966c88 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:25.863946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffacf0-07b2-4614-94a4-b9015c966c88 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:25.864270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffacf0-07b2-4614-94a4-b9015c966c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:25.917603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-53ffacf0-07b2-4614-94a4-b9015c966c88 None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:25.929266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-53ffacf0-07b2-4614-94a4-b9015c966c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:26.049812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccf154-26f2-4466-940c-ca4abce97171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.051324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbccf154-26f2-4466-940c-ca4abce97171 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.092348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 917/1801] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:26.154459 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 885/1802] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:43:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:26.774575 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf154-26f2-4466-940c-ca4abce97171 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.776167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cbccf154-26f2-4466-940c-ca4abce97171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:26.793490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbccf154-26f2-4466-940c-ca4abce97171 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:26.799989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a46196-7939-41e7-b1a2-ab31d7ab4dab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:26.800661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a46196-7939-41e7-b1a2-ab31d7ab4dab service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:26.800943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a46196-7939-41e7-b1a2-ab31d7ab4dab service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:26.801206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a46196-7939-41e7-b1a2-ab31d7ab4dab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:26.811388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a46196-7939-41e7-b1a2-ab31d7ab4dab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:26.813120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a46196-7939-41e7-b1a2-ab31d7ab4dab service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:26.824912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffacf0-07b2-4614-94a4-b9015c966c88 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.827757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 918/1803] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:26.829994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-53ffacf0-07b2-4614-94a4-b9015c966c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:26.895261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a46196-7939-41e7-b1a2-ab31d7ab4dab service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:26.898373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-70a46196-7939-41e7-b1a2-ab31d7ab4dab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:26.988682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.010128 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffacf0-07b2-4614-94a4-b9015c966c88 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.016529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.017673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.017967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.018277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] PATH_INFO: `/v3/projects/b9c62ce8366c4a5593361d4fbb9d1a0f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.019599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9c62ce8366c4a5593361d4fbb9d1a0f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.022246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.037017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a46196-7939-41e7-b1a2-ab31d7ab4dab service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.042639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.043332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.043630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.044533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] PATH_INFO: `/v3/projects/331dc1e4b4414fb29cb21c8e5cb9bfbe` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.045848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=331dc1e4b4414fb29cb21c8e5cb9bfbe)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.047852 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.071967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.080621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9c62ce8366c4a5593361d4fbb9d1a0f', 'request_id': 'req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.092579 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9c62ce8366c4a5593361d4fbb9d1a0f', 'request_id': 'req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.100715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9c62ce8366c4a5593361d4fbb9d1a0f', 'request_id': 'req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.109573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '331dc1e4b4414fb29cb21c8e5cb9bfbe', 'request_id': 'req-080041c5-7d65-4ca0-b7d3-52a31537f9ba'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.114605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] The token cache is being invalidate because project b9c62ce8366c4a5593361d4fbb9d1a0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:27.114969 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.115788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-cfdfe3ba-a0f6-4334-9369-4c7034c288ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.120495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 886/1804] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:26 2022] DELETE /identity/v3/projects/b9c62ce8366c4a5593361d4fbb9d1a0f => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:27.120495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68f32-c23f-46a7-8f60-0402f7c9ec57 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.120495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68f32-c23f-46a7-8f60-0402f7c9ec57 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.120495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee68f32-c23f-46a7-8f60-0402f7c9ec57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.127224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '331dc1e4b4414fb29cb21c8e5cb9bfbe', 'request_id': 'req-080041c5-7d65-4ca0-b7d3-52a31537f9ba'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.139745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '331dc1e4b4414fb29cb21c8e5cb9bfbe', 'request_id': 'req-080041c5-7d65-4ca0-b7d3-52a31537f9ba'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.143265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1ee68f32-c23f-46a7-8f60-0402f7c9ec57 None None] MFA Rules not processed for user `43fc4ad124f943c086954c28a0a6e199`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:27.144502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1ee68f32-c23f-46a7-8f60-0402f7c9ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:27.156083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] The token cache is being invalidate because project 331dc1e4b4414fb29cb21c8e5cb9bfbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:27.156794 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.157355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.159088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 919/1805] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:26 2022] DELETE /identity/v3/projects/331dc1e4b4414fb29cb21c8e5cb9bfbe => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:27.159765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.161110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:27.229019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 887/1806] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:27.235636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68f32-c23f-46a7-8f60-0402f7c9ec57 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:27.237117 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1ee68f32-c23f-46a7-8f60-0402f7c9ec57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:27.242309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080041c5-7d65-4ca0-b7d3-52a31537f9ba admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.248407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.250825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.251387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.252079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] PATH_INFO: `/v3/users/83cc353e0f68422480f9c4acb403a792` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.257850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee68f32-c23f-46a7-8f60-0402f7c9ec57 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:27.258030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83cc353e0f68422480f9c4acb403a792)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.260731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.263210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:27.264343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:27.264707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:27.265059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] PATH_INFO: `/v3/users/95ffd230c09242d08da5c9a405513d65` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:27.267353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ffd230c09242d08da5c9a405513d65)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:27.269532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:27.332058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83cc353e0f68422480f9c4acb403a792'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.343952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ffd230c09242d08da5c9a405513d65'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.344832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ffd230c09242d08da5c9a405513d65'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.345666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ffd230c09242d08da5c9a405513d65'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.346388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83cc353e0f68422480f9c4acb403a792'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.354414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83cc353e0f68422480f9c4acb403a792'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.357859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:27.365915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ffd230c09242d08da5c9a405513d65'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.374879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ffd230c09242d08da5c9a405513d65'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.395290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 888/1807] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:27 2022] DELETE /identity/v3/users/95ffd230c09242d08da5c9a405513d65 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:27.404434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83cc353e0f68422480f9c4acb403a792'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.413269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83cc353e0f68422480f9c4acb403a792'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:27.431040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 920/1808] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:27 2022] DELETE /identity/v3/users/83cc353e0f68422480f9c4acb403a792 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:28.635324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.637110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:28.756020 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:28.780773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6493dbc5-78aa-4fcd-9e77-428e62b1e1a3 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.871034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:28.872183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.872544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.872889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] PATH_INFO: `/v3/projects/641b341127d44060b3cc7473dbf845e7` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:28.874535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=641b341127d44060b3cc7473dbf845e7)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:28.877276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:28.923149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:28.925698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:28.936813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '641b341127d44060b3cc7473dbf845e7', 'request_id': 'req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.940973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8139475-2659-479f-9366-d0c36ecd8918 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:28.950846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '641b341127d44060b3cc7473dbf845e7', 'request_id': 'req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.959322 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '641b341127d44060b3cc7473dbf845e7', 'request_id': 'req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.972488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] The token cache is being invalidate because project 641b341127d44060b3cc7473dbf845e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:28.972956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.974423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4dfe3387-30c3-4574-8768-4c8c1f14eaf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:28.976497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 889/1809] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:28 2022] DELETE /identity/v3/projects/641b341127d44060b3cc7473dbf845e7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:28.983657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c1dc8-fb27-4e90-9ed2-ba3e827d2491 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:28.983940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c1dc8-fb27-4e90-9ed2-ba3e827d2491 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:28.984217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082c1dc8-fb27-4e90-9ed2-ba3e827d2491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.028253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-082c1dc8-fb27-4e90-9ed2-ba3e827d2491 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:29.029587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-082c1dc8-fb27-4e90-9ed2-ba3e827d2491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:29.041936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.042847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.043135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.043413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] PATH_INFO: `/v3/projects/3eebe49b54d34842b5d6f9150bbadea7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.044629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3eebe49b54d34842b5d6f9150bbadea7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.046664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.102048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3eebe49b54d34842b5d6f9150bbadea7', 'request_id': 'req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:29.104037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 890/1810] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:29.111628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9fda-168e-4dd5-a390-901fcf935ec0 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.111951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9fda-168e-4dd5-a390-901fcf935ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.112311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5d9fda-168e-4dd5-a390-901fcf935ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.114321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3eebe49b54d34842b5d6f9150bbadea7', 'request_id': 'req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:29.121382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3eebe49b54d34842b5d6f9150bbadea7', 'request_id': 'req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:29.134071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] The token cache is being invalidate because project 3eebe49b54d34842b5d6f9150bbadea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:29.134478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:29.135099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0c9e8da4-213a-41e7-b82c-9e72a95a8efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:29.136640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 921/1811] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:28 2022] DELETE /identity/v3/projects/3eebe49b54d34842b5d6f9150bbadea7 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:29.137062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-6a5d9fda-168e-4dd5-a390-901fcf935ec0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:29.138481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6a5d9fda-168e-4dd5-a390-901fcf935ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:29.142686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ed80f-ec2d-4a4a-b546-bfede6e78a6a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.143195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ed80f-ec2d-4a4a-b546-bfede6e78a6a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.143715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ed80f-ec2d-4a4a-b546-bfede6e78a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.186258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:29.193005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-985ed80f-ec2d-4a4a-b546-bfede6e78a6a None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:29.194464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-985ed80f-ec2d-4a4a-b546-bfede6e78a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:29.249107 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 891/1812] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:29.253328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d9fda-168e-4dd5-a390-901fcf935ec0 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.267110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5d9fda-168e-4dd5-a390-901fcf935ec0 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.272412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db8dc5-672b-4e74-ae16-b7df49781669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.273398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db8dc5-672b-4e74-ae16-b7df49781669 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.273706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db8dc5-672b-4e74-ae16-b7df49781669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.273987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db8dc5-672b-4e74-ae16-b7df49781669 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.274774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db8dc5-672b-4e74-ae16-b7df49781669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:29.275081 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db8dc5-672b-4e74-ae16-b7df49781669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.277408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db8dc5-672b-4e74-ae16-b7df49781669 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.278920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 922/1813] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:29.287490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7576e-1c35-4c49-b461-3a6a5de33644 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.288089 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7576e-1c35-4c49-b461-3a6a5de33644 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.288599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7576e-1c35-4c49-b461-3a6a5de33644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.293136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 892/1814] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:29.297847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:29.298027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db8dc5-672b-4e74-ae16-b7df49781669 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.311354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db8dc5-672b-4e74-ae16-b7df49781669 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.315196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e9f7576e-1c35-4c49-b461-3a6a5de33644 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:29.317909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ef69d-573e-49ca-b02d-460a98a3efb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.318649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ef69d-573e-49ca-b02d-460a98a3efb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.318916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ef69d-573e-49ca-b02d-460a98a3efb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.319277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ef69d-573e-49ca-b02d-460a98a3efb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.319963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e9f7576e-1c35-4c49-b461-3a6a5de33644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:29.320260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ef69d-573e-49ca-b02d-460a98a3efb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.323131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ef69d-573e-49ca-b02d-460a98a3efb4 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.332350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 923/1815] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:29.336449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7576e-1c35-4c49-b461-3a6a5de33644 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.348810 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7576e-1c35-4c49-b461-3a6a5de33644 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.353989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cbbf9-8569-4f2b-a8d7-102061596e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.354684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbbf9-8569-4f2b-a8d7-102061596e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.355000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbbf9-8569-4f2b-a8d7-102061596e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.355267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbbf9-8569-4f2b-a8d7-102061596e93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.355984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 893/1816] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:29.356093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cbbf9-8569-4f2b-a8d7-102061596e93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:29.356515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cbbf9-8569-4f2b-a8d7-102061596e93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.358438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cbbf9-8569-4f2b-a8d7-102061596e93 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.359805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ef69d-573e-49ca-b02d-460a98a3efb4 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.374125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 924/1817] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:29.389334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cbbf9-8569-4f2b-a8d7-102061596e93 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.413424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cbbf9-8569-4f2b-a8d7-102061596e93 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.481153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ef69d-573e-49ca-b02d-460a98a3efb4 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.492009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767527-be37-42db-9d92-3000426e8ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.492796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767527-be37-42db-9d92-3000426e8ed8 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.493082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767527-be37-42db-9d92-3000426e8ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.493356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767527-be37-42db-9d92-3000426e8ed8 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.494048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df767527-be37-42db-9d92-3000426e8ed8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.499278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df767527-be37-42db-9d92-3000426e8ed8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.513548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3339a-9e57-46cb-90ae-f729e18b3850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.515372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3339a-9e57-46cb-90ae-f729e18b3850 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.516802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3339a-9e57-46cb-90ae-f729e18b3850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.517091 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3339a-9e57-46cb-90ae-f729e18b3850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.518479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3339a-9e57-46cb-90ae-f729e18b3850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.521714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3339a-9e57-46cb-90ae-f729e18b3850 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.546842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 894/1818] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/users => generated 282 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:29.551172 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767527-be37-42db-9d92-3000426e8ed8 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.565561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767527-be37-42db-9d92-3000426e8ed8 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.573895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b274e-9e21-4a2f-aa9c-18dae69d883c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.574569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b274e-9e21-4a2f-aa9c-18dae69d883c admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.574887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b274e-9e21-4a2f-aa9c-18dae69d883c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.575354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b274e-9e21-4a2f-aa9c-18dae69d883c admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.576180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b274e-9e21-4a2f-aa9c-18dae69d883c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.579152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b274e-9e21-4a2f-aa9c-18dae69d883c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.597165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 895/1819] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:43:29.602215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 925/1820] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/projects => generated 383 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:29.607233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b274e-9e21-4a2f-aa9c-18dae69d883c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.607712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3339a-9e57-46cb-90ae-f729e18b3850 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.626617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b274e-9e21-4a2f-aa9c-18dae69d883c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.716404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603641e-ccaf-4d28-92dd-4be5d43c2651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.717950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603641e-ccaf-4d28-92dd-4be5d43c2651 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.718459 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603641e-ccaf-4d28-92dd-4be5d43c2651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.718957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603641e-ccaf-4d28-92dd-4be5d43c2651 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.720340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603641e-ccaf-4d28-92dd-4be5d43c2651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.723061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603641e-ccaf-4d28-92dd-4be5d43c2651 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.726171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3339a-9e57-46cb-90ae-f729e18b3850 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.733876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaee235-8f01-41a1-8742-16cb8cd8e2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.735133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaee235-8f01-41a1-8742-16cb8cd8e2fe admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.735418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaee235-8f01-41a1-8742-16cb8cd8e2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.735687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaee235-8f01-41a1-8742-16cb8cd8e2fe admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.736533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaee235-8f01-41a1-8742-16cb8cd8e2fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.738744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaee235-8f01-41a1-8742-16cb8cd8e2fe admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.739722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 896/1821] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:29.743556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603641e-ccaf-4d28-92dd-4be5d43c2651 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.758300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:29.762793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603641e-ccaf-4d28-92dd-4be5d43c2651 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.772288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e09dbe-fd89-48fa-978c-77fa94157593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.772963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 926/1822] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:29.774768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e09dbe-fd89-48fa-978c-77fa94157593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.775188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e09dbe-fd89-48fa-978c-77fa94157593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.775696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e09dbe-fd89-48fa-978c-77fa94157593 admin admin] PATH_INFO: `/v3/projects/ace868f5c5fc4b648d951370cd28400f/users/dc57bac675ca4e71bddf1a78e214cf4b/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.778416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaee235-8f01-41a1-8742-16cb8cd8e2fe admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.805541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaee235-8f01-41a1-8742-16cb8cd8e2fe admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.813579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ed8f7-de24-4230-8e81-9e295cda9cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.814023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ed8f7-de24-4230-8e81-9e295cda9cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.814368 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ed8f7-de24-4230-8e81-9e295cda9cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.815076 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ed8f7-de24-4230-8e81-9e295cda9cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.815829 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ed8f7-de24-4230-8e81-9e295cda9cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.817457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ed8f7-de24-4230-8e81-9e295cda9cd0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.828428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e09dbe-fd89-48fa-978c-77fa94157593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ace868f5c5fc4b648d951370cd28400f, user_id=dc57bac675ca4e71bddf1a78e214cf4b, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.839242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 927/1823] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:29.844340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ed8f7-de24-4230-8e81-9e295cda9cd0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:29.847608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e09dbe-fd89-48fa-978c-77fa94157593 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:29.875724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ed8f7-de24-4230-8e81-9e295cda9cd0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:29.878129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 897/1824] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:29 2022] PUT /identity/v3/projects/ace868f5c5fc4b648d951370cd28400f/users/dc57bac675ca4e71bddf1a78e214cf4b/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:29.890183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42852fc2-300f-450b-bb7f-d6ed44e71336 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.890567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42852fc2-300f-450b-bb7f-d6ed44e71336 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.891385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42852fc2-300f-450b-bb7f-d6ed44e71336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.941068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-42852fc2-300f-450b-bb7f-d6ed44e71336 None None] MFA Rules not processed for user `dc57bac675ca4e71bddf1a78e214cf4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:29.944481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-42852fc2-300f-450b-bb7f-d6ed44e71336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:29.962519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:29.981435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef6e10-53e1-4ea7-87bb-ddaf7141a0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:29.981696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef6e10-53e1-4ea7-87bb-ddaf7141a0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:29.982129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef6e10-53e1-4ea7-87bb-ddaf7141a0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:29.982473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef6e10-53e1-4ea7-87bb-ddaf7141a0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:29.984068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef6e10-53e1-4ea7-87bb-ddaf7141a0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:29.986583 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef6e10-53e1-4ea7-87bb-ddaf7141a0a0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.003855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 928/1825] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:30.010444 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef6e10-53e1-4ea7-87bb-ddaf7141a0a0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.037515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef6e10-53e1-4ea7-87bb-ddaf7141a0a0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.052715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9300f2d-c036-40b1-9fb7-95e3643c5fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.054427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300f2d-c036-40b1-9fb7-95e3643c5fd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.066212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300f2d-c036-40b1-9fb7-95e3643c5fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.070788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9300f2d-c036-40b1-9fb7-95e3643c5fd8 admin admin] PATH_INFO: `/v3/projects/7455b4633dc84cd0848d383780886021/users/fc044a7ff72a4c5f95cc32ea540de184/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.099470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 898/1826] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:30.100951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9300f2d-c036-40b1-9fb7-95e3643c5fd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7455b4633dc84cd0848d383780886021, user_id=fc044a7ff72a4c5f95cc32ea540de184, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:30.104300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9300f2d-c036-40b1-9fb7-95e3643c5fd8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.117803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42852fc2-300f-450b-bb7f-d6ed44e71336 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.126107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 929/1827] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:30 2022] PUT /identity/v3/projects/7455b4633dc84cd0848d383780886021/users/fc044a7ff72a4c5f95cc32ea540de184/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:30.139764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecbd8f-cbff-4386-b9f8-4a1e5d73e8f7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.142197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecbd8f-cbff-4386-b9f8-4a1e5d73e8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.142847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ecbd8f-cbff-4386-b9f8-4a1e5d73e8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.162443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42852fc2-300f-450b-bb7f-d6ed44e71336 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.206775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d3ecbd8f-cbff-4386-b9f8-4a1e5d73e8f7 None None] MFA Rules not processed for user `fc044a7ff72a4c5f95cc32ea540de184`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:30.208764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d3ecbd8f-cbff-4386-b9f8-4a1e5d73e8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:30.341693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af696b3e-a1f6-4288-8ae5-e2dcccc30752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.342782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af696b3e-a1f6-4288-8ae5-e2dcccc30752 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.343170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af696b3e-a1f6-4288-8ae5-e2dcccc30752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.344427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af696b3e-a1f6-4288-8ae5-e2dcccc30752 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.345304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af696b3e-a1f6-4288-8ae5-e2dcccc30752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:30.349965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af696b3e-a1f6-4288-8ae5-e2dcccc30752 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.387452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 930/1828] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:30.405778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecbd8f-cbff-4386-b9f8-4a1e5d73e8f7 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.407318 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d3ecbd8f-cbff-4386-b9f8-4a1e5d73e8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:30.421080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 899/1829] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:30 2022] POST /identity/v3/projects => generated 365 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:30.424834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af696b3e-a1f6-4288-8ae5-e2dcccc30752 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.509898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ecbd8f-cbff-4386-b9f8-4a1e5d73e8f7 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.559521 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:30.568873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af696b3e-a1f6-4288-8ae5-e2dcccc30752 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.579879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da785f-3af4-402d-b7be-077337b12527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.580625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da785f-3af4-402d-b7be-077337b12527 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.580907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da785f-3af4-402d-b7be-077337b12527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.581182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da785f-3af4-402d-b7be-077337b12527 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.581904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da785f-3af4-402d-b7be-077337b12527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:30.583860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da785f-3af4-402d-b7be-077337b12527 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.593376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecaa17-460a-47d1-bc18-d9cb3f0fcacd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.594467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecaa17-460a-47d1-bc18-d9cb3f0fcacd service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.594982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecaa17-460a-47d1-bc18-d9cb3f0fcacd service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.595594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ecaa17-460a-47d1-bc18-d9cb3f0fcacd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.621678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 900/1830] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:30 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:30.625930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:30.627415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da785f-3af4-402d-b7be-077337b12527 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.646644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da785f-3af4-402d-b7be-077337b12527 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.665010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79bc58-0c03-4bf3-93f1-1687b1d04db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.665669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79bc58-0c03-4bf3-93f1-1687b1d04db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.665946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79bc58-0c03-4bf3-93f1-1687b1d04db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.666314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79bc58-0c03-4bf3-93f1-1687b1d04db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.667126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79bc58-0c03-4bf3-93f1-1687b1d04db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:30.669283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b79bc58-0c03-4bf3-93f1-1687b1d04db2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.684605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 901/1831] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:30.689848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79bc58-0c03-4bf3-93f1-1687b1d04db2 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.700144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecaa17-460a-47d1-bc18-d9cb3f0fcacd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:30.703320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79bc58-0c03-4bf3-93f1-1687b1d04db2 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.704372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ecaa17-460a-47d1-bc18-d9cb3f0fcacd service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.713847 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82499d38-c75f-425e-860c-9452ae70959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.714954 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499d38-c75f-425e-860c-9452ae70959b admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.715340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499d38-c75f-425e-860c-9452ae70959b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.715727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82499d38-c75f-425e-860c-9452ae70959b admin admin] PATH_INFO: `/v3/projects/5e96c1565d0746438ce0861005fbfae6/users/93e36ea307504ac5a4c0cebc9f34b463/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.723617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 931/1832] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:30.739659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82499d38-c75f-425e-860c-9452ae70959b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e96c1565d0746438ce0861005fbfae6, user_id=93e36ea307504ac5a4c0cebc9f34b463, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:30.747060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82499d38-c75f-425e-860c-9452ae70959b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.769884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecaa17-460a-47d1-bc18-d9cb3f0fcacd service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.772059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-90ecaa17-460a-47d1-bc18-d9cb3f0fcacd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:30.780955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 902/1833] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:30 2022] PUT /identity/v3/projects/5e96c1565d0746438ce0861005fbfae6/users/93e36ea307504ac5a4c0cebc9f34b463/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:30.782359 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82499d38-c75f-425e-860c-9452ae70959b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:30.791440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ecaa17-460a-47d1-bc18-d9cb3f0fcacd service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.914722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82499d38-c75f-425e-860c-9452ae70959b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:30.915283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.916212 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.916493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.916769 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] PATH_INFO: `/v3/users/b92111350e7a4d338b63fc7bcf497615` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.917976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92111350e7a4d338b63fc7bcf497615)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:30.920156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.921987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:30.924702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:30.925330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:30.925889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] PATH_INFO: `/v3/users/fc044a7ff72a4c5f95cc32ea540de184` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:30.928480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc044a7ff72a4c5f95cc32ea540de184)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:30.931503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:30.984820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92111350e7a4d338b63fc7bcf497615'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:30.992506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc044a7ff72a4c5f95cc32ea540de184'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:30.993189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92111350e7a4d338b63fc7bcf497615'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:30.993466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc044a7ff72a4c5f95cc32ea540de184'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:30.993984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92111350e7a4d338b63fc7bcf497615'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:30.994197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc044a7ff72a4c5f95cc32ea540de184'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:31.007900 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc044a7ff72a4c5f95cc32ea540de184'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:31.008709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92111350e7a4d338b63fc7bcf497615'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:31.015064 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a0325b19-7fd4-4186-9479-7e5bf27ae4ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc044a7ff72a4c5f95cc32ea540de184'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:31.017351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92111350e7a4d338b63fc7bcf497615'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:31.032009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 932/1834] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:30 2022] DELETE /identity/v3/users/b92111350e7a4d338b63fc7bcf497615 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:31.032439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 903/1835] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:30 2022] DELETE /identity/v3/users/fc044a7ff72a4c5f95cc32ea540de184 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:31.035083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.036655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:31.037185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba794a5-3ecf-4e55-a14b-a09ca340c99b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.037478 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba794a5-3ecf-4e55-a14b-a09ca340c99b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.037753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba794a5-3ecf-4e55-a14b-a09ca340c99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.054974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-bba794a5-3ecf-4e55-a14b-a09ca340c99b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:31.056208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-bba794a5-3ecf-4e55-a14b-a09ca340c99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:31.081859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.082502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.116883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc2b1a-f2c1-4771-9c64-676c033a9424 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.125939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 904/1836] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:31.125939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e21a-40e9-4880-be30-747cdddcd4af None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.125939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e21a-40e9-4880-be30-747cdddcd4af None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.125939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e21a-40e9-4880-be30-747cdddcd4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.134923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23bc7e-6cc6-4132-a47e-9b95355fb1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.135546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23bc7e-6cc6-4132-a47e-9b95355fb1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.135835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23bc7e-6cc6-4132-a47e-9b95355fb1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.136115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e23bc7e-6cc6-4132-a47e-9b95355fb1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.136858 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23bc7e-6cc6-4132-a47e-9b95355fb1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.138529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e23bc7e-6cc6-4132-a47e-9b95355fb1f6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.146502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-88b2e21a-40e9-4880-be30-747cdddcd4af None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:31.147807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-88b2e21a-40e9-4880-be30-747cdddcd4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:31.150978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 933/1837] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:31.151667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23bc7e-6cc6-4132-a47e-9b95355fb1f6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.153271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3e23bc7e-6cc6-4132-a47e-9b95355fb1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:31.159073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 905/1838] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:31.159888 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2e21a-40e9-4880-be30-747cdddcd4af None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.169348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2e21a-40e9-4880-be30-747cdddcd4af None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.174315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc8cea-97f8-43eb-bfe0-f425389f20ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.175210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc8cea-97f8-43eb-bfe0-f425389f20ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.175488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc8cea-97f8-43eb-bfe0-f425389f20ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.178011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc8cea-97f8-43eb-bfe0-f425389f20ce admin admin] PATH_INFO: `/v3/projects/5e96c1565d0746438ce0861005fbfae6/users/93e36ea307504ac5a4c0cebc9f34b463/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.178011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc8cea-97f8-43eb-bfe0-f425389f20ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e96c1565d0746438ce0861005fbfae6, user_id=93e36ea307504ac5a4c0cebc9f34b463, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.180562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cc8cea-97f8-43eb-bfe0-f425389f20ce admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.192679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 906/1839] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:31 2022] PUT /identity/v3/projects/5e96c1565d0746438ce0861005fbfae6/users/93e36ea307504ac5a4c0cebc9f34b463/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:31.202494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc8cea-97f8-43eb-bfe0-f425389f20ce admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.204812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-08cc8cea-97f8-43eb-bfe0-f425389f20ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:31.225999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e23bc7e-6cc6-4132-a47e-9b95355fb1f6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.299849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620fbea-07b3-40a2-bc7d-363c6b0ab94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.300845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620fbea-07b3-40a2-bc7d-363c6b0ab94b service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.301350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620fbea-07b3-40a2-bc7d-363c6b0ab94b service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.301874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620fbea-07b3-40a2-bc7d-363c6b0ab94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.304011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cc8cea-97f8-43eb-bfe0-f425389f20ce admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.314301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df661ca-f14c-42b3-b31f-2b6ace007a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.315355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df661ca-f14c-42b3-b31f-2b6ace007a33 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.316247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df661ca-f14c-42b3-b31f-2b6ace007a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.317404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df661ca-f14c-42b3-b31f-2b6ace007a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.465664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df661ca-f14c-42b3-b31f-2b6ace007a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.471828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df661ca-f14c-42b3-b31f-2b6ace007a33 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.486959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620fbea-07b3-40a2-bc7d-363c6b0ab94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.488886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620fbea-07b3-40a2-bc7d-363c6b0ab94b service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.506102 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 907/1840] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:31.508872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a1a7b-8234-4a96-b2d0-a7bc491d036f None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.509164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a1a7b-8234-4a96-b2d0-a7bc491d036f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.509447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a1a7b-8234-4a96-b2d0-a7bc491d036f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.514270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 934/1841] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:31.598740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-bf8a1a7b-8234-4a96-b2d0-a7bc491d036f None None] MFA Rules not processed for user `93e36ea307504ac5a4c0cebc9f34b463`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:31.600090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-bf8a1a7b-8234-4a96-b2d0-a7bc491d036f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:31.725017 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.805173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 908/1842] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:31.816448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620fbea-07b3-40a2-bc7d-363c6b0ab94b service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:31.817710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4620fbea-07b3-40a2-bc7d-363c6b0ab94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:31.909694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:31.942804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620fbea-07b3-40a2-bc7d-363c6b0ab94b service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:31.946965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c195af-8158-4471-9bc0-0afc28cc215c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:31.947629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c195af-8158-4471-9bc0-0afc28cc215c service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:31.947984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c195af-8158-4471-9bc0-0afc28cc215c service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:31.948182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c195af-8158-4471-9bc0-0afc28cc215c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:31.962302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c195af-8158-4471-9bc0-0afc28cc215c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:31.963830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c195af-8158-4471-9bc0-0afc28cc215c service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:31.977782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 935/1843] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:31 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:32.112451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a1a7b-8234-4a96-b2d0-a7bc491d036f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.130520 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a1a7b-8234-4a96-b2d0-a7bc491d036f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.138127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31850-fcd8-4f99-8658-d1c4b0374109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.139133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31850-fcd8-4f99-8658-d1c4b0374109 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.139244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31850-fcd8-4f99-8658-d1c4b0374109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.139476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d31850-fcd8-4f99-8658-d1c4b0374109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.142391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-02d31850-fcd8-4f99-8658-d1c4b0374109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:32.275224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d31850-fcd8-4f99-8658-d1c4b0374109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.277298 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d31850-fcd8-4f99-8658-d1c4b0374109 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.302226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 909/1844] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:32.500772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c195af-8158-4471-9bc0-0afc28cc215c service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.525488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-30c195af-8158-4471-9bc0-0afc28cc215c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:32.553987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c195af-8158-4471-9bc0-0afc28cc215c service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.556110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31850-fcd8-4f99-8658-d1c4b0374109 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.557580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-02d31850-fcd8-4f99-8658-d1c4b0374109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:32.572297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.573427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.573565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.573799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] PATH_INFO: `/v3/projects/7455b4633dc84cd0848d383780886021` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.573895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d31850-fcd8-4f99-8658-d1c4b0374109 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.575732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7455b4633dc84cd0848d383780886021)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.578998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.591913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.592910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.593179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.593542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] PATH_INFO: `/v3/projects/a42ced1a309b45168bb1e60506aea18f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.596428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42ced1a309b45168bb1e60506aea18f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.599009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.663801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7455b4633dc84cd0848d383780886021', 'request_id': 'req-8af883da-3c8a-41d1-b54c-154b36730f9c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.678332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7455b4633dc84cd0848d383780886021', 'request_id': 'req-8af883da-3c8a-41d1-b54c-154b36730f9c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.681031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42ced1a309b45168bb1e60506aea18f', 'request_id': 'req-0b7287b2-c22f-4187-961f-a53346e438e3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.690868 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42ced1a309b45168bb1e60506aea18f', 'request_id': 'req-0b7287b2-c22f-4187-961f-a53346e438e3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.694657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7455b4633dc84cd0848d383780886021', 'request_id': 'req-8af883da-3c8a-41d1-b54c-154b36730f9c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.701503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42ced1a309b45168bb1e60506aea18f', 'request_id': 'req-0b7287b2-c22f-4187-961f-a53346e438e3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.717675 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] The token cache is being invalidate because project 7455b4633dc84cd0848d383780886021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:32.718066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.718850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8af883da-3c8a-41d1-b54c-154b36730f9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.721922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 936/1845] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:32 2022] DELETE /identity/v3/projects/7455b4633dc84cd0848d383780886021 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:32.728442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] The token cache is being invalidate because project a42ced1a309b45168bb1e60506aea18f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:32.729066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.729735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.732147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 910/1846] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:32 2022] DELETE /identity/v3/projects/a42ced1a309b45168bb1e60506aea18f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:32.735923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1ad17-5e1c-4c51-b341-c71084345479 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.736205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:32.737474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1ad17-5e1c-4c51-b341-c71084345479 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.737952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:32.739303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1ad17-5e1c-4c51-b341-c71084345479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.804242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7ee1ad17-5e1c-4c51-b341-c71084345479 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:32.807125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7ee1ad17-5e1c-4c51-b341-c71084345479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:32.840609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7287b2-c22f-4187-961f-a53346e438e3 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:32.852960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:32.853879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.854386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.854627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] PATH_INFO: `/v3/users/418757ea228843668d63ea74a80096b4` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:32.857821 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=418757ea228843668d63ea74a80096b4)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:32.860193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:32.869299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:32.955930 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '418757ea228843668d63ea74a80096b4'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.956637 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '418757ea228843668d63ea74a80096b4'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.957411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '418757ea228843668d63ea74a80096b4'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.986523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 937/1847] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:32.999365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3846720-ab3c-4547-bdd5-7838b7d4b0e1 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:32.999365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3846720-ab3c-4547-bdd5-7838b7d4b0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:32.999581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '418757ea228843668d63ea74a80096b4'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:32.999685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3846720-ab3c-4547-bdd5-7838b7d4b0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.012754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '418757ea228843668d63ea74a80096b4'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:33.025295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d3846720-ab3c-4547-bdd5-7838b7d4b0e1 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:33.027658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d3846720-ab3c-4547-bdd5-7838b7d4b0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:33.044446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 911/1848] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:32 2022] DELETE /identity/v3/users/418757ea228843668d63ea74a80096b4 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:33.051991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 938/1849] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:33.058052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.129172 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9a0d3-7120-44e2-a1a8-9a1b367eb4d5 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.136262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16c9af-6f2d-4def-ac51-e9f558eafeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.137131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16c9af-6f2d-4def-ac51-e9f558eafeba admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.137426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16c9af-6f2d-4def-ac51-e9f558eafeba admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.137861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16c9af-6f2d-4def-ac51-e9f558eafeba admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.138927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16c9af-6f2d-4def-ac51-e9f558eafeba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:33.139184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16c9af-6f2d-4def-ac51-e9f558eafeba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.141620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16c9af-6f2d-4def-ac51-e9f558eafeba admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.163710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 912/1850] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:33.168391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3846720-ab3c-4547-bdd5-7838b7d4b0e1 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.186169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3846720-ab3c-4547-bdd5-7838b7d4b0e1 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.196477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc98972-e2b6-4fcc-952b-efabdcfce599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.198016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc98972-e2b6-4fcc-952b-efabdcfce599 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.198613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc98972-e2b6-4fcc-952b-efabdcfce599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.199121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc98972-e2b6-4fcc-952b-efabdcfce599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.200074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc98972-e2b6-4fcc-952b-efabdcfce599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.202579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc98972-e2b6-4fcc-952b-efabdcfce599 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.238024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 939/1851] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:33 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:33.242130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16c9af-6f2d-4def-ac51-e9f558eafeba admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.259060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16c9af-6f2d-4def-ac51-e9f558eafeba admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.347294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c2253-9fe1-4935-ad62-0e2f32989d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.347294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c2253-9fe1-4935-ad62-0e2f32989d11 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.347294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c2253-9fe1-4935-ad62-0e2f32989d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.347294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852c2253-9fe1-4935-ad62-0e2f32989d11 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.350969 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c2253-9fe1-4935-ad62-0e2f32989d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.352674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852c2253-9fe1-4935-ad62-0e2f32989d11 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.390404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 913/1852] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:33 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:33.390745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc98972-e2b6-4fcc-952b-efabdcfce599 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.417531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc98972-e2b6-4fcc-952b-efabdcfce599 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.439194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8ff8e-13ed-40f9-8aef-b880999f1f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.439194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ff8e-13ed-40f9-8aef-b880999f1f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.439194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ff8e-13ed-40f9-8aef-b880999f1f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.442277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af8ff8e-13ed-40f9-8aef-b880999f1f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.443901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8ff8e-13ed-40f9-8aef-b880999f1f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.448693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af8ff8e-13ed-40f9-8aef-b880999f1f83 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.481525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 940/1853] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:43:33.486109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c2253-9fe1-4935-ad62-0e2f32989d11 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.514487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852c2253-9fe1-4935-ad62-0e2f32989d11 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.532230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bd1dc-72b0-4979-8bfb-70c8c47525d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.536368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd1dc-72b0-4979-8bfb-70c8c47525d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.537133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd1dc-72b0-4979-8bfb-70c8c47525d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.538017 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bd1dc-72b0-4979-8bfb-70c8c47525d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.539542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bd1dc-72b0-4979-8bfb-70c8c47525d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.542546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bd1dc-72b0-4979-8bfb-70c8c47525d6 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.548316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:33.593589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 914/1854] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:33.595653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8ff8e-13ed-40f9-8aef-b880999f1f83 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.610905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af8ff8e-13ed-40f9-8aef-b880999f1f83 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:33.637877 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449ae57-513b-44b3-b2da-3be34e531ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:33.639463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449ae57-513b-44b3-b2da-3be34e531ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.641478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449ae57-513b-44b3-b2da-3be34e531ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.642171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449ae57-513b-44b3-b2da-3be34e531ec2 admin admin] PATH_INFO: `/v3/projects/92d24c0f9b0f4ef4b3aae354684d9d55/users/e5b2f2d1d5b84ceb92afc41624795f82/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.667332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449ae57-513b-44b3-b2da-3be34e531ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d24c0f9b0f4ef4b3aae354684d9d55, user_id=e5b2f2d1d5b84ceb92afc41624795f82, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:33.670737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449ae57-513b-44b3-b2da-3be34e531ec2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:33.720927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 941/1855] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:33 2022] PUT /identity/v3/projects/92d24c0f9b0f4ef4b3aae354684d9d55/users/e5b2f2d1d5b84ceb92afc41624795f82/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:33.723734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d27cf-2d28-467f-8c1b-3c900c2f9d61 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:33.724193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d27cf-2d28-467f-8c1b-3c900c2f9d61 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:33.724566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d27cf-2d28-467f-8c1b-3c900c2f9d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:33.796853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d56d27cf-2d28-467f-8c1b-3c900c2f9d61 None None] MFA Rules not processed for user `e5b2f2d1d5b84ceb92afc41624795f82`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:33.798925 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d56d27cf-2d28-467f-8c1b-3c900c2f9d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:33.977145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449ae57-513b-44b3-b2da-3be34e531ec2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:33.979785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7449ae57-513b-44b3-b2da-3be34e531ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:33.985032 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 915/1856] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:33.986292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:33.986407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d27cf-2d28-467f-8c1b-3c900c2f9d61 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.140487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d27cf-2d28-467f-8c1b-3c900c2f9d61 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.153703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c408ee-1863-4034-a109-3c9bbbc61953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.154280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c408ee-1863-4034-a109-3c9bbbc61953 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.154567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c408ee-1863-4034-a109-3c9bbbc61953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.154833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c408ee-1863-4034-a109-3c9bbbc61953 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.155550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c408ee-1863-4034-a109-3c9bbbc61953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.157684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c408ee-1863-4034-a109-3c9bbbc61953 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.229197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 916/1857] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:33 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:34.230472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c408ee-1863-4034-a109-3c9bbbc61953 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.273038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449ae57-513b-44b3-b2da-3be34e531ec2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.357036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c408ee-1863-4034-a109-3c9bbbc61953 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.376908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bbf18-22bf-4657-8f5d-e63fb5a7c8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.377887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bbf18-22bf-4657-8f5d-e63fb5a7c8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.378208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bbf18-22bf-4657-8f5d-e63fb5a7c8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.378497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30bbf18-22bf-4657-8f5d-e63fb5a7c8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.379687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bbf18-22bf-4657-8f5d-e63fb5a7c8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.381702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30bbf18-22bf-4657-8f5d-e63fb5a7c8a8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.438164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 917/1858] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:34.441548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bbf18-22bf-4657-8f5d-e63fb5a7c8a8 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.452644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:34.461652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30bbf18-22bf-4657-8f5d-e63fb5a7c8a8 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.479111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72e889-f280-4ab1-a48d-4465c6770854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.480405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72e889-f280-4ab1-a48d-4465c6770854 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.480979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72e889-f280-4ab1-a48d-4465c6770854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.481416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72e889-f280-4ab1-a48d-4465c6770854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.482489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72e889-f280-4ab1-a48d-4465c6770854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.490785 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72e889-f280-4ab1-a48d-4465c6770854 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.494938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.495849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.496135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.496408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] PATH_INFO: `/v3/projects/0700c955b266469e94fd525900301d67` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.499190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0700c955b266469e94fd525900301d67)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.501952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.510279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 918/1859] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:34.519547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72e889-f280-4ab1-a48d-4465c6770854 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.566237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72e889-f280-4ab1-a48d-4465c6770854 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.578908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f15d-5f61-4287-830c-24474200bce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.579689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f15d-5f61-4287-830c-24474200bce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.579981 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f15d-5f61-4287-830c-24474200bce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.580387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e5f15d-5f61-4287-830c-24474200bce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.581096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5f15d-5f61-4287-830c-24474200bce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.582771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e5f15d-5f61-4287-830c-24474200bce9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.618656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 919/1860] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:34.625618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f15d-5f61-4287-830c-24474200bce9 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:34.642313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0700c955b266469e94fd525900301d67', 'request_id': 'req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:34.666783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0700c955b266469e94fd525900301d67', 'request_id': 'req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:34.668813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e5f15d-5f61-4287-830c-24474200bce9 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:34.678915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0700c955b266469e94fd525900301d67', 'request_id': 'req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:34.700404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] The token cache is being invalidate because project 0700c955b266469e94fd525900301d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:34.700628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:34.701305 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7cdf0160-8d77-4680-afe4-fb2f8e2de63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:34.708419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 942/1861] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:33 2022] DELETE /identity/v3/projects/0700c955b266469e94fd525900301d67 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:34.714677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abdf6e-d76c-422e-ad91-ca31895a228f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.714959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abdf6e-d76c-422e-ad91-ca31895a228f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.715234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9abdf6e-d76c-422e-ad91-ca31895a228f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.772489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c9abdf6e-d76c-422e-ad91-ca31895a228f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:34.774123 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c9abdf6e-d76c-422e-ad91-ca31895a228f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:34.810922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a901f-00d1-48fd-8d61-6d81ca83de31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:34.811916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a901f-00d1-48fd-8d61-6d81ca83de31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.812204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a901f-00d1-48fd-8d61-6d81ca83de31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.812487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a901f-00d1-48fd-8d61-6d81ca83de31 admin admin] PATH_INFO: `/v3/projects/cbb8d2cdb2e441e096ba0e189e37acce/users/6cbff02296f547aeb5b3d2bd250a09b1/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.847771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a901f-00d1-48fd-8d61-6d81ca83de31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbb8d2cdb2e441e096ba0e189e37acce, user_id=6cbff02296f547aeb5b3d2bd250a09b1, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:34.851626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a901f-00d1-48fd-8d61-6d81ca83de31 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:34.875942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 920/1862] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:34 2022] PUT /identity/v3/projects/cbb8d2cdb2e441e096ba0e189e37acce/users/6cbff02296f547aeb5b3d2bd250a09b1/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:34.886153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e688-a394-4200-982e-dd0ada621762 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.886425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e688-a394-4200-982e-dd0ada621762 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.886714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7e688-a394-4200-982e-dd0ada621762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.894292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:34.933871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-83c7e688-a394-4200-982e-dd0ada621762 None None] MFA Rules not processed for user `6cbff02296f547aeb5b3d2bd250a09b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:34.935372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-83c7e688-a394-4200-982e-dd0ada621762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:34.941175 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 943/1863] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:34.954310 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23315560-982e-4480-9db4-8e53e1f7a2b2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:34.955220 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23315560-982e-4480-9db4-8e53e1f7a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:34.955220 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23315560-982e-4480-9db4-8e53e1f7a2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:34.977634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-23315560-982e-4480-9db4-8e53e1f7a2b2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:34.979055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-23315560-982e-4480-9db4-8e53e1f7a2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:35.080041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 921/1864] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:35.087804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7e688-a394-4200-982e-dd0ada621762 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.100879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-83c7e688-a394-4200-982e-dd0ada621762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:35.101693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 944/1865] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:35.103578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23315560-982e-4480-9db4-8e53e1f7a2b2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.123716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23315560-982e-4480-9db4-8e53e1f7a2b2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.128328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7e688-a394-4200-982e-dd0ada621762 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.135731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4178d-aa0e-400c-9c23-0f08ba1fad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.137252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290b3b-e745-47c4-8484-db6e5f27b334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.138223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290b3b-e745-47c4-8484-db6e5f27b334 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.138668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290b3b-e745-47c4-8484-db6e5f27b334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.138851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4178d-aa0e-400c-9c23-0f08ba1fad4b admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.139146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4178d-aa0e-400c-9c23-0f08ba1fad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.139467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4178d-aa0e-400c-9c23-0f08ba1fad4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.139569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2290b3b-e745-47c4-8484-db6e5f27b334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.140401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4178d-aa0e-400c-9c23-0f08ba1fad4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.147890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4178d-aa0e-400c-9c23-0f08ba1fad4b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.151572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290b3b-e745-47c4-8484-db6e5f27b334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:35.153222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290b3b-e745-47c4-8484-db6e5f27b334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.159593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2290b3b-e745-47c4-8484-db6e5f27b334 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.186320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 945/1866] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:35.189779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290b3b-e745-47c4-8484-db6e5f27b334 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.202051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 922/1867] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:35 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:35.206541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4178d-aa0e-400c-9c23-0f08ba1fad4b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.212062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2290b3b-e745-47c4-8484-db6e5f27b334 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.284378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:35.352183 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940dc9b-9d05-4e00-8672-93e49f321cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.352781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940dc9b-9d05-4e00-8672-93e49f321cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.353069 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940dc9b-9d05-4e00-8672-93e49f321cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.353350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940dc9b-9d05-4e00-8672-93e49f321cbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.354053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940dc9b-9d05-4e00-8672-93e49f321cbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.354702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4178d-aa0e-400c-9c23-0f08ba1fad4b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.363812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1940dc9b-9d05-4e00-8672-93e49f321cbb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.366549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567d1ef-149e-44d2-bc72-5431f0a30c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.367298 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d1ef-149e-44d2-bc72-5431f0a30c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.367594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d1ef-149e-44d2-bc72-5431f0a30c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.367871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567d1ef-149e-44d2-bc72-5431f0a30c2e admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.368602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567d1ef-149e-44d2-bc72-5431f0a30c2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.370607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567d1ef-149e-44d2-bc72-5431f0a30c2e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.419645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 923/1868] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:35 2022] POST /identity/v3/users => generated 295 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:35.426231 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567d1ef-149e-44d2-bc72-5431f0a30c2e admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.444182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567d1ef-149e-44d2-bc72-5431f0a30c2e admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.451806 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d440d2-99b5-4cbd-ad0b-cfca790cb3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.452777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d440d2-99b5-4cbd-ad0b-cfca790cb3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.453262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d440d2-99b5-4cbd-ad0b-cfca790cb3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.453646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d440d2-99b5-4cbd-ad0b-cfca790cb3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.455486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d440d2-99b5-4cbd-ad0b-cfca790cb3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.458208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d440d2-99b5-4cbd-ad0b-cfca790cb3dc admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.461200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 946/1869] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:35 2022] POST /identity/v3/projects => generated 373 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:35.465435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940dc9b-9d05-4e00-8672-93e49f321cbb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.485590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 924/1870] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:35.489417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d440d2-99b5-4cbd-ad0b-cfca790cb3dc admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.528973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d440d2-99b5-4cbd-ad0b-cfca790cb3dc admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.639353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:35.666477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940dc9b-9d05-4e00-8672-93e49f321cbb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.674909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57986299-6539-4d0d-85cf-429f770f73ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.676309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57986299-6539-4d0d-85cf-429f770f73ba admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.678064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57986299-6539-4d0d-85cf-429f770f73ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.678448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57986299-6539-4d0d-85cf-429f770f73ba admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.679307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57986299-6539-4d0d-85cf-429f770f73ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.681914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57986299-6539-4d0d-85cf-429f770f73ba admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.725679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 947/1871] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:35 2022] POST /identity/v3/users => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:35.733094 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57986299-6539-4d0d-85cf-429f770f73ba admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.746282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57986299-6539-4d0d-85cf-429f770f73ba admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.758217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f13e5-bf9e-4eb2-a222-5ccdadb86b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.761847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f13e5-bf9e-4eb2-a222-5ccdadb86b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.762222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f13e5-bf9e-4eb2-a222-5ccdadb86b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.762533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f13e5-bf9e-4eb2-a222-5ccdadb86b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.763304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f13e5-bf9e-4eb2-a222-5ccdadb86b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.770991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f13e5-bf9e-4eb2-a222-5ccdadb86b96 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.798429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb4bc2-05b8-4d1a-b933-6babd869545b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.801164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb4bc2-05b8-4d1a-b933-6babd869545b admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.801308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb4bc2-05b8-4d1a-b933-6babd869545b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.801820 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb4bc2-05b8-4d1a-b933-6babd869545b admin admin] PATH_INFO: `/v3/projects/6c3f1114bb3249bcb0a50c24a9abece3/users/6a57fab9144c41f0a72cb87f73866d04/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.806337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 948/1872] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:35.809232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f13e5-bf9e-4eb2-a222-5ccdadb86b96 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.837659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f13e5-bf9e-4eb2-a222-5ccdadb86b96 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:35.854948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832f62d-e0c1-4d4a-a0bb-e3b776b56782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:35.855651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832f62d-e0c1-4d4a-a0bb-e3b776b56782 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:35.855973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832f62d-e0c1-4d4a-a0bb-e3b776b56782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:35.856268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3832f62d-e0c1-4d4a-a0bb-e3b776b56782 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:35.857012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832f62d-e0c1-4d4a-a0bb-e3b776b56782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.861703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3832f62d-e0c1-4d4a-a0bb-e3b776b56782 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.874465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb4bc2-05b8-4d1a-b933-6babd869545b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3f1114bb3249bcb0a50c24a9abece3, user_id=6a57fab9144c41f0a72cb87f73866d04, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:35.881762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb4bc2-05b8-4d1a-b933-6babd869545b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:35.889291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 949/1873] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:35.895454 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832f62d-e0c1-4d4a-a0bb-e3b776b56782 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.914833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 925/1874] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:35 2022] PUT /identity/v3/projects/6c3f1114bb3249bcb0a50c24a9abece3/users/6a57fab9144c41f0a72cb87f73866d04/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:35.919117 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb4bc2-05b8-4d1a-b933-6babd869545b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:35.926550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3832f62d-e0c1-4d4a-a0bb-e3b776b56782 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.104364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ba242-8e5b-4223-b364-a74a467564d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.105648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ba242-8e5b-4223-b364-a74a467564d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.106046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ba242-8e5b-4223-b364-a74a467564d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.106505 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ba242-8e5b-4223-b364-a74a467564d7 admin admin] PATH_INFO: `/v3/projects/b10db47f175340a1828d888ea9e4cb7a/users/9c654619cbf840e8ad33f9b9afe074e7/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.128194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb4bc2-05b8-4d1a-b933-6babd869545b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.134494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ba242-8e5b-4223-b364-a74a467564d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10db47f175340a1828d888ea9e4cb7a, user_id=9c654619cbf840e8ad33f9b9afe074e7, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.138140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ba242-8e5b-4223-b364-a74a467564d7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.151451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed3543d-4270-4416-b682-dafe9546adaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.152151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3543d-4270-4416-b682-dafe9546adaf admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.152435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3543d-4270-4416-b682-dafe9546adaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.152918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed3543d-4270-4416-b682-dafe9546adaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.153513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3543d-4270-4416-b682-dafe9546adaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.155320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed3543d-4270-4416-b682-dafe9546adaf admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.159364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 950/1875] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:35 2022] PUT /identity/v3/projects/b10db47f175340a1828d888ea9e4cb7a/users/9c654619cbf840e8ad33f9b9afe074e7/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:36.169405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ba242-8e5b-4223-b364-a74a467564d7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.171993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-694ba242-8e5b-4223-b364-a74a467564d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.205729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 926/1876] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:35 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:36.207719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c93ee-065e-448f-9931-0230ce05fd73 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.208020 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c93ee-065e-448f-9931-0230ce05fd73 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.208781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c93ee-065e-448f-9931-0230ce05fd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.260483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-020c93ee-065e-448f-9931-0230ce05fd73 None None] MFA Rules not processed for user `9c654619cbf840e8ad33f9b9afe074e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:36.263962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-020c93ee-065e-448f-9931-0230ce05fd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.299012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:36.313634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ba242-8e5b-4223-b364-a74a467564d7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.319431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.320552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.321803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.321803 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] PATH_INFO: `/v3/users/dc57bac675ca4e71bddf1a78e214cf4b` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.322440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc57bac675ca4e71bddf1a78e214cf4b)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.325778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.377549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 927/1877] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:36.382435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c93ee-065e-448f-9931-0230ce05fd73 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.389521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:36.392735 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc57bac675ca4e71bddf1a78e214cf4b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:36.394951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c93ee-065e-448f-9931-0230ce05fd73 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.400825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a6658-3dc7-42e3-a338-208cb0f05659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.401889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a6658-3dc7-42e3-a338-208cb0f05659 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.402326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a6658-3dc7-42e3-a338-208cb0f05659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.402762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a6658-3dc7-42e3-a338-208cb0f05659 admin admin] PATH_INFO: `/v3/projects/6c3f1114bb3249bcb0a50c24a9abece3/users/6a57fab9144c41f0a72cb87f73866d04/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.403009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc57bac675ca4e71bddf1a78e214cf4b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:36.403965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc57bac675ca4e71bddf1a78e214cf4b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:36.406001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a6658-3dc7-42e3-a338-208cb0f05659 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3f1114bb3249bcb0a50c24a9abece3, user_id=6a57fab9144c41f0a72cb87f73866d04, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.409041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50a6658-3dc7-42e3-a338-208cb0f05659 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.417492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc57bac675ca4e71bddf1a78e214cf4b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:36.425709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-83e56a94-f483-4a88-bcf1-a7f4ed6d9e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc57bac675ca4e71bddf1a78e214cf4b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:36.439291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 928/1878] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:36 2022] PUT /identity/v3/projects/6c3f1114bb3249bcb0a50c24a9abece3/users/6a57fab9144c41f0a72cb87f73866d04/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:36.439291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a6658-3dc7-42e3-a338-208cb0f05659 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.439291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b50a6658-3dc7-42e3-a338-208cb0f05659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.439840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 951/1879] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:36 2022] DELETE /identity/v3/users/dc57bac675ca4e71bddf1a78e214cf4b => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:36.440276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d6db3-cd34-483c-8d1c-c1e713dcb85f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.441467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d6db3-cd34-483c-8d1c-c1e713dcb85f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.441467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d6db3-cd34-483c-8d1c-c1e713dcb85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.479929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1e1d6db3-cd34-483c-8d1c-c1e713dcb85f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:36.481639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1e1d6db3-cd34-483c-8d1c-c1e713dcb85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.530582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50a6658-3dc7-42e3-a338-208cb0f05659 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.570820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 952/1880] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:36.571813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17bfe8-dd62-440f-b4af-12e927ab37e4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.572109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17bfe8-dd62-440f-b4af-12e927ab37e4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.572588 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17bfe8-dd62-440f-b4af-12e927ab37e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.601113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90a143-20f3-4f8c-b98f-6be999534511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.601803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90a143-20f3-4f8c-b98f-6be999534511 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.603293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90a143-20f3-4f8c-b98f-6be999534511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.603650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90a143-20f3-4f8c-b98f-6be999534511 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.604801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90a143-20f3-4f8c-b98f-6be999534511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.606961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f90a143-20f3-4f8c-b98f-6be999534511 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.607140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9c17bfe8-dd62-440f-b4af-12e927ab37e4 None None] MFA Rules not processed for user `6a57fab9144c41f0a72cb87f73866d04`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:36.608721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9c17bfe8-dd62-440f-b4af-12e927ab37e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.644677 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 929/1881] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:36 2022] POST /identity/v3/projects => generated 379 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:36.645887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90a143-20f3-4f8c-b98f-6be999534511 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.647563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8f90a143-20f3-4f8c-b98f-6be999534511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.712879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:36.746139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f90a143-20f3-4f8c-b98f-6be999534511 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.760019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d04343-6d65-4528-8e1f-f0f2d4bf9f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.761151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d04343-6d65-4528-8e1f-f0f2d4bf9f14 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.761654 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d04343-6d65-4528-8e1f-f0f2d4bf9f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.762311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d04343-6d65-4528-8e1f-f0f2d4bf9f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.844910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 953/1882] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:36.845872 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17bfe8-dd62-440f-b4af-12e927ab37e4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.869771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17bfe8-dd62-440f-b4af-12e927ab37e4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:36.915240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d04343-6d65-4528-8e1f-f0f2d4bf9f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.916882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d04343-6d65-4528-8e1f-f0f2d4bf9f14 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:36.931795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 930/1883] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:36.933825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d04343-6d65-4528-8e1f-f0f2d4bf9f14 service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:36.934949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-58d04343-6d65-4528-8e1f-f0f2d4bf9f14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:36.950305 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:36.969370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4ed4b-ae12-4533-b5f7-268adb20eec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:36.970287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4ed4b-ae12-4533-b5f7-268adb20eec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:36.970728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4ed4b-ae12-4533-b5f7-268adb20eec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:36.971672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4ed4b-ae12-4533-b5f7-268adb20eec4 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:36.972402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4ed4b-ae12-4533-b5f7-268adb20eec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:36.976321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4ed4b-ae12-4533-b5f7-268adb20eec4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.011966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 954/1884] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:36 2022] POST /identity/v3/users => generated 296 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:37.016933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4ed4b-ae12-4533-b5f7-268adb20eec4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.029515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4ed4b-ae12-4533-b5f7-268adb20eec4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.035640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6e0a8-036a-40e2-826e-f0c17a47f984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.036320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6e0a8-036a-40e2-826e-f0c17a47f984 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.036900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6e0a8-036a-40e2-826e-f0c17a47f984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.036900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e6e0a8-036a-40e2-826e-f0c17a47f984 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.037969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6e0a8-036a-40e2-826e-f0c17a47f984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.040350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e6e0a8-036a-40e2-826e-f0c17a47f984 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.049974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d04343-6d65-4528-8e1f-f0f2d4bf9f14 service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.061260 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 955/1885] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:37.063057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffa86b-98b4-451d-b6b9-1d6a85d88cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.063940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6e0a8-036a-40e2-826e-f0c17a47f984 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.065333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa86b-98b4-451d-b6b9-1d6a85d88cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.065779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa86b-98b4-451d-b6b9-1d6a85d88cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.066204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bffa86b-98b4-451d-b6b9-1d6a85d88cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.068212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4bffa86b-98b4-451d-b6b9-1d6a85d88cc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:37.088405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e6e0a8-036a-40e2-826e-f0c17a47f984 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.102991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cb69d-cd82-406b-93bd-d19ee35a1ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.105057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb69d-cd82-406b-93bd-d19ee35a1ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.106335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb69d-cd82-406b-93bd-d19ee35a1ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.106873 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb69d-cd82-406b-93bd-d19ee35a1ae3 admin admin] PATH_INFO: `/v3/projects/02b2b37c1d10468f89f6ae4cff9ad1d6/users/5f20a60d6f704cf3a0c93272f828950a/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.128352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cb69d-cd82-406b-93bd-d19ee35a1ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b2b37c1d10468f89f6ae4cff9ad1d6, user_id=5f20a60d6f704cf3a0c93272f828950a, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.133863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cb69d-cd82-406b-93bd-d19ee35a1ae3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.161781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 956/1886] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:37 2022] PUT /identity/v3/projects/02b2b37c1d10468f89f6ae4cff9ad1d6/users/5f20a60d6f704cf3a0c93272f828950a/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:37.164291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cb69d-cd82-406b-93bd-d19ee35a1ae3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.217056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffa86b-98b4-451d-b6b9-1d6a85d88cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.218451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bffa86b-98b4-451d-b6b9-1d6a85d88cc3 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.235039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 931/1887] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:37.319476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cb69d-cd82-406b-93bd-d19ee35a1ae3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.328671 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c5346-5f33-4bbb-9d0b-4936a4301fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.329620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c5346-5f33-4bbb-9d0b-4936a4301fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.330292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c5346-5f33-4bbb-9d0b-4936a4301fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.330725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c5346-5f33-4bbb-9d0b-4936a4301fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.331623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c5346-5f33-4bbb-9d0b-4936a4301fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.333816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c5346-5f33-4bbb-9d0b-4936a4301fc2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.352754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 957/1888] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:37.354329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffa86b-98b4-451d-b6b9-1d6a85d88cc3 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.373856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bffa86b-98b4-451d-b6b9-1d6a85d88cc3 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.384053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5e71f-25f9-463a-a419-673f2af9a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.385184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5e71f-25f9-463a-a419-673f2af9a1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.385553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5e71f-25f9-463a-a419-673f2af9a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.385919 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de5e71f-25f9-463a-a419-673f2af9a1b2 admin admin] PATH_INFO: `/v3/projects/02b2b37c1d10468f89f6ae4cff9ad1d6/users/5f20a60d6f704cf3a0c93272f828950a/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.389192 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5e71f-25f9-463a-a419-673f2af9a1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02b2b37c1d10468f89f6ae4cff9ad1d6, user_id=5f20a60d6f704cf3a0c93272f828950a, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.394248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de5e71f-25f9-463a-a419-673f2af9a1b2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.427791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 932/1889] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:37 2022] PUT /identity/v3/projects/02b2b37c1d10468f89f6ae4cff9ad1d6/users/5f20a60d6f704cf3a0c93272f828950a/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:37.439626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc511bcf-0884-4e53-8e5c-1e5083e58f7f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.439930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc511bcf-0884-4e53-8e5c-1e5083e58f7f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.440198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc511bcf-0884-4e53-8e5c-1e5083e58f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.474507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bc511bcf-0884-4e53-8e5c-1e5083e58f7f None None] MFA Rules not processed for user `5f20a60d6f704cf3a0c93272f828950a`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:37.475758 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bc511bcf-0884-4e53-8e5c-1e5083e58f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:37.569589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 958/1890] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:37 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:37.577535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5e71f-25f9-463a-a419-673f2af9a1b2 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:37.580334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0de5e71f-25f9-463a-a419-673f2af9a1b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:37.645414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:37.720849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de5e71f-25f9-463a-a419-673f2af9a1b2 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:37.731296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56692813-4d66-42cc-b9a6-a7281b3645c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:37.732459 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56692813-4d66-42cc-b9a6-a7281b3645c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:37.732845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56692813-4d66-42cc-b9a6-a7281b3645c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:37.733264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56692813-4d66-42cc-b9a6-a7281b3645c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:37.764883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56692813-4d66-42cc-b9a6-a7281b3645c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:37.771494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56692813-4d66-42cc-b9a6-a7281b3645c5 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:37.793696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 933/1891] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:38.253070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc511bcf-0884-4e53-8e5c-1e5083e58f7f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.255842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bc511bcf-0884-4e53-8e5c-1e5083e58f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:38.330973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:38.357800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56692813-4d66-42cc-b9a6-a7281b3645c5 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.369946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56692813-4d66-42cc-b9a6-a7281b3645c5 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.377117 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45057-387e-4006-9f7e-dcca559074e6 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f20a60d6f704cf3a0c93272f828950a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b2b37c1d10468f89f6ae4cff9ad1d6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.378187 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45057-387e-4006-9f7e-dcca559074e6 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.378424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45057-387e-4006-9f7e-dcca559074e6 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.378759 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff45057-387e-4006-9f7e-dcca559074e6 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.379824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff45057-387e-4006-9f7e-dcca559074e6 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:38.379937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff45057-387e-4006-9f7e-dcca559074e6 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.383744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff45057-387e-4006-9f7e-dcca559074e6 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.403871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 934/1892] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:38.415134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45057-387e-4006-9f7e-dcca559074e6 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.430341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc511bcf-0884-4e53-8e5c-1e5083e58f7f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.430602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff45057-387e-4006-9f7e-dcca559074e6 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.436276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8a95-10ab-4a51-afd6-a8880609cc14 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f20a60d6f704cf3a0c93272f828950a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b2b37c1d10468f89f6ae4cff9ad1d6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.436480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.438328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.438942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.439308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] PATH_INFO: `/v3/projects/ace868f5c5fc4b648d951370cd28400f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.439576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8a95-10ab-4a51-afd6-a8880609cc14 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.440024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8a95-10ab-4a51-afd6-a8880609cc14 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.440585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f8a95-10ab-4a51-afd6-a8880609cc14 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.441085 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ace868f5c5fc4b648d951370cd28400f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.441629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f8a95-10ab-4a51-afd6-a8880609cc14 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.443327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.444612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f8a95-10ab-4a51-afd6-a8880609cc14 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.511256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 935/1893] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:38 2022] POST /identity/v3/projects => generated 353 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:38.512675 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8a95-10ab-4a51-afd6-a8880609cc14 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.607648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ace868f5c5fc4b648d951370cd28400f', 'request_id': 'req-c1801644-a3c3-44e8-be25-ac0afdac5ed2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:38.630389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ace868f5c5fc4b648d951370cd28400f', 'request_id': 'req-c1801644-a3c3-44e8-be25-ac0afdac5ed2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:38.648477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ace868f5c5fc4b648d951370cd28400f', 'request_id': 'req-c1801644-a3c3-44e8-be25-ac0afdac5ed2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:38.663499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f8a95-10ab-4a51-afd6-a8880609cc14 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.664003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] The token cache is being invalidate because project ace868f5c5fc4b648d951370cd28400f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:38.665027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:38.665952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:38.668545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 959/1894] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:38 2022] DELETE /identity/v3/projects/ace868f5c5fc4b648d951370cd28400f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:38.675817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.677670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:38.762760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cc795-2b2e-4629-9702-e15033d26a09 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f20a60d6f704cf3a0c93272f828950a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b2b37c1d10468f89f6ae4cff9ad1d6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.763456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cc795-2b2e-4629-9702-e15033d26a09 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.763746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cc795-2b2e-4629-9702-e15033d26a09 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.764029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cc795-2b2e-4629-9702-e15033d26a09 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.764773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cc795-2b2e-4629-9702-e15033d26a09 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:38.765086 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cc795-2b2e-4629-9702-e15033d26a09 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.766778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cc795-2b2e-4629-9702-e15033d26a09 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.775189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1801644-a3c3-44e8-be25-ac0afdac5ed2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.785934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 936/1895] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:38.789151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.790727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.790883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.791142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] PATH_INFO: `/v3/users/93e36ea307504ac5a4c0cebc9f34b463` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.792829 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93e36ea307504ac5a4c0cebc9f34b463)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.794616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.847645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cc795-2b2e-4629-9702-e15033d26a09 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:38.860556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8e0cc795-2b2e-4629-9702-e15033d26a09 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:38.877132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cc795-2b2e-4629-9702-e15033d26a09 tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:38.883778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f20a60d6f704cf3a0c93272f828950a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02b2b37c1d10468f89f6ae4cff9ad1d6', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:38.884716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:38.885645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:38.886027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] PATH_INFO: `/v3/projects/ff6d9ea070484cf3adfa3325013995ba` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:38.888162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ff6d9ea070484cf3adfa3325013995ba)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:38.892588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:38.902431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93e36ea307504ac5a4c0cebc9f34b463'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:38.917333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93e36ea307504ac5a4c0cebc9f34b463'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:38.918145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93e36ea307504ac5a4c0cebc9f34b463'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:38.922247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:38.942414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93e36ea307504ac5a4c0cebc9f34b463'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:38.952285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93e36ea307504ac5a4c0cebc9f34b463'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:38.964298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 960/1896] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:38 2022] DELETE /identity/v3/users/93e36ea307504ac5a4c0cebc9f34b463 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:38.976448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:38.994780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6d9ea070484cf3adfa3325013995ba', 'request_id': 'req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.006546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6d9ea070484cf3adfa3325013995ba', 'request_id': 'req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.018851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6d9ea070484cf3adfa3325013995ba', 'request_id': 'req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.034761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] The token cache is being invalidate because project ff6d9ea070484cf3adfa3325013995ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:39.035472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.036250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.038817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 937/1897] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:38 2022] DELETE /identity/v3/projects/ff6d9ea070484cf3adfa3325013995ba => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:39.296218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:39.296218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:39.360001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:39.362144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:39.462182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b84669-1774-41a6-b1f8-d1d3afe12f8f tempest-VolumeQuotaClassesTest-606137737 tempest-VolumeQuotaClassesTest-606137737-project-admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:39.467570 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656ed37-2af1-42b4-8c27-59026715fd7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:39.468594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ed37-2af1-42b4-8c27-59026715fd7c service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.468965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ed37-2af1-42b4-8c27-59026715fd7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.469378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656ed37-2af1-42b4-8c27-59026715fd7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.471990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f656ed37-2af1-42b4-8c27-59026715fd7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:39.510980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58df54-b4dc-4389-b17b-7fe2a69eaaa7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:39.583549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656ed37-2af1-42b4-8c27-59026715fd7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:39.587584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656ed37-2af1-42b4-8c27-59026715fd7c service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:39.598874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 938/1898] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:39.599695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656ed37-2af1-42b4-8c27-59026715fd7c service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:39.601417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f656ed37-2af1-42b4-8c27-59026715fd7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:39.623735 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:39.624786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.625739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.626241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] PATH_INFO: `/v3/users/9c654619cbf840e8ad33f9b9afe074e7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.628060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c654619cbf840e8ad33f9b9afe074e7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:39.629753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:39.706802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c654619cbf840e8ad33f9b9afe074e7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.720257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c654619cbf840e8ad33f9b9afe074e7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.721351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c654619cbf840e8ad33f9b9afe074e7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.732745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656ed37-2af1-42b4-8c27-59026715fd7c service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:39.740280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:39.741445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.741770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.742052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] PATH_INFO: `/v3/projects/5e96c1565d0746438ce0861005fbfae6` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.743712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e96c1565d0746438ce0861005fbfae6)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:39.746133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:39.747904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c654619cbf840e8ad33f9b9afe074e7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.761913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f391ee4-9107-4ba0-bd59-588314cce938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c654619cbf840e8ad33f9b9afe074e7'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.764727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:39.772156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 961/1899] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:39 2022] DELETE /identity/v3/users/9c654619cbf840e8ad33f9b9afe074e7 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:39.772602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:39.779061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50288b67-f1ee-4358-98cd-b343814d3928 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.779733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50288b67-f1ee-4358-98cd-b343814d3928 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.780323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50288b67-f1ee-4358-98cd-b343814d3928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:39.805858 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-50288b67-f1ee-4358-98cd-b343814d3928 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:39.807444 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-50288b67-f1ee-4358-98cd-b343814d3928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:39.870917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e96c1565d0746438ce0861005fbfae6', 'request_id': 'req-33b7b91d-9040-43c0-9224-1218b7414d96'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.908688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e96c1565d0746438ce0861005fbfae6', 'request_id': 'req-33b7b91d-9040-43c0-9224-1218b7414d96'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.939444 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e96c1565d0746438ce0861005fbfae6', 'request_id': 'req-33b7b91d-9040-43c0-9224-1218b7414d96'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.967281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 962/1900] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:39.977551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50288b67-f1ee-4358-98cd-b343814d3928 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:39.979127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] The token cache is being invalidate because project 5e96c1565d0746438ce0861005fbfae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:39.979432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.980099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-33b7b91d-9040-43c0-9224-1218b7414d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:39.980981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-50288b67-f1ee-4358-98cd-b343814d3928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:39.981892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 939/1901] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:39 2022] DELETE /identity/v3/projects/5e96c1565d0746438ce0861005fbfae6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:39.989559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4e91d-5212-47e2-ba94-3f83a05cd711 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:39.989984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4e91d-5212-47e2-ba94-3f83a05cd711 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:39.990472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4e91d-5212-47e2-ba94-3f83a05cd711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.026985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c5e4e91d-5212-47e2-ba94-3f83a05cd711 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:40.032238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c5e4e91d-5212-47e2-ba94-3f83a05cd711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:40.102664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50288b67-f1ee-4358-98cd-b343814d3928 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.148349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 940/1902] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:40.158331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff68d6-0218-498f-ab52-ed439572b33f None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.158845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff68d6-0218-498f-ab52-ed439572b33f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.159310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff68d6-0218-498f-ab52-ed439572b33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.166142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaddafc-11bd-4ec6-924e-473aedd357ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.167989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaddafc-11bd-4ec6-924e-473aedd357ce service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.169825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaddafc-11bd-4ec6-924e-473aedd357ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.170805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaddafc-11bd-4ec6-924e-473aedd357ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.174319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-dfaddafc-11bd-4ec6-924e-473aedd357ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:40.189828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d5ff68d6-0218-498f-ab52-ed439572b33f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:40.190703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaddafc-11bd-4ec6-924e-473aedd357ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.192500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaddafc-11bd-4ec6-924e-473aedd357ce service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.192676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d5ff68d6-0218-498f-ab52-ed439572b33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:40.207136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 941/1903] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:40.211131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 963/1904] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:40.214243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff68d6-0218-498f-ab52-ed439572b33f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.225739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff68d6-0218-498f-ab52-ed439572b33f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.231203 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e931886-f328-4311-870e-f551345d52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.231879 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931886-f328-4311-870e-f551345d52f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.232161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931886-f328-4311-870e-f551345d52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.232433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e931886-f328-4311-870e-f551345d52f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.233168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e931886-f328-4311-870e-f551345d52f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:40.233499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e931886-f328-4311-870e-f551345d52f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.235236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e931886-f328-4311-870e-f551345d52f5 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.254417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 942/1905] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:40.255403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaddafc-11bd-4ec6-924e-473aedd357ce service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.274512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaddafc-11bd-4ec6-924e-473aedd357ce service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.286040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289451b-7f19-45db-9d5d-3f0ba271570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.286753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289451b-7f19-45db-9d5d-3f0ba271570b admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.287224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289451b-7f19-45db-9d5d-3f0ba271570b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.287516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289451b-7f19-45db-9d5d-3f0ba271570b admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.288684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289451b-7f19-45db-9d5d-3f0ba271570b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.290768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289451b-7f19-45db-9d5d-3f0ba271570b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.322127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 964/1906] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:40 2022] POST /identity/v3/projects => generated 393 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:40.326307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e931886-f328-4311-870e-f551345d52f5 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.340998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e931886-f328-4311-870e-f551345d52f5 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.458472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ef123-32b2-41fc-8f9e-4c9822dc6b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.458472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ef123-32b2-41fc-8f9e-4c9822dc6b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.458472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ef123-32b2-41fc-8f9e-4c9822dc6b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.458472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ef123-32b2-41fc-8f9e-4c9822dc6b6a admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.459961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ef123-32b2-41fc-8f9e-4c9822dc6b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.462168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ef123-32b2-41fc-8f9e-4c9822dc6b6a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.502606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 943/1907] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:40 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:40.505951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289451b-7f19-45db-9d5d-3f0ba271570b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.533476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289451b-7f19-45db-9d5d-3f0ba271570b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.542827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639025e-1a51-4707-97ab-e2e71fa2d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.544038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639025e-1a51-4707-97ab-e2e71fa2d2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.545780 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639025e-1a51-4707-97ab-e2e71fa2d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.546467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639025e-1a51-4707-97ab-e2e71fa2d2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.549210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639025e-1a51-4707-97ab-e2e71fa2d2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.550998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4639025e-1a51-4707-97ab-e2e71fa2d2bd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.572377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 965/1908] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:40.575774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ef123-32b2-41fc-8f9e-4c9822dc6b6a admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.600917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ef123-32b2-41fc-8f9e-4c9822dc6b6a admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.616452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8e352-2146-4073-9ac2-a906ae42de4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.617149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8e352-2146-4073-9ac2-a906ae42de4d admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.617539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8e352-2146-4073-9ac2-a906ae42de4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.617851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8e352-2146-4073-9ac2-a906ae42de4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.619867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8e352-2146-4073-9ac2-a906ae42de4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.623111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b8e352-2146-4073-9ac2-a906ae42de4d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.642519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 944/1909] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:40.647656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639025e-1a51-4707-97ab-e2e71fa2d2bd admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.670584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4639025e-1a51-4707-97ab-e2e71fa2d2bd admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.676156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ae943-b878-42bb-8007-b4f90bfdbae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.677167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ae943-b878-42bb-8007-b4f90bfdbae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.677452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ae943-b878-42bb-8007-b4f90bfdbae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.677763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ae943-b878-42bb-8007-b4f90bfdbae6 admin admin] PATH_INFO: `/v3/projects/aeec52b77bc64aed9502283679e3dcdd/users/5863c78faf764468979b821c88746aa5/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.696935 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8e352-2146-4073-9ac2-a906ae42de4d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.701853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-19b8e352-2146-4073-9ac2-a906ae42de4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:40.708239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ae943-b878-42bb-8007-b4f90bfdbae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeec52b77bc64aed9502283679e3dcdd, user_id=5863c78faf764468979b821c88746aa5, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.711403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ae943-b878-42bb-8007-b4f90bfdbae6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.728799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:40.734195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 966/1910] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:40 2022] PUT /identity/v3/projects/aeec52b77bc64aed9502283679e3dcdd/users/5863c78faf764468979b821c88746aa5/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:40.735394 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ae943-b878-42bb-8007-b4f90bfdbae6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:40.737019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8e352-2146-4073-9ac2-a906ae42de4d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.746969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b50ae943-b878-42bb-8007-b4f90bfdbae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:40.755943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:40.845284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.846440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.849693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.850529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] PATH_INFO: `/v3/projects/b10db47f175340a1828d888ea9e4cb7a` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.852313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10db47f175340a1828d888ea9e4cb7a)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.854492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:40.863719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ae943-b878-42bb-8007-b4f90bfdbae6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:40.872611 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245010e-1b62-4d9e-9131-55cf889b35eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:40.873449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245010e-1b62-4d9e-9131-55cf889b35eb service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:40.874219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245010e-1b62-4d9e-9131-55cf889b35eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:40.874651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245010e-1b62-4d9e-9131-55cf889b35eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:40.877538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e245010e-1b62-4d9e-9131-55cf889b35eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:40.977381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10db47f175340a1828d888ea9e4cb7a', 'request_id': 'req-0d988ab0-b227-4646-aac9-09fe7709fc7d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:40.997820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245010e-1b62-4d9e-9131-55cf889b35eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:40.999669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245010e-1b62-4d9e-9131-55cf889b35eb service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.009811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10db47f175340a1828d888ea9e4cb7a', 'request_id': 'req-0d988ab0-b227-4646-aac9-09fe7709fc7d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:41.014721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 967/1911] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:40 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:41.027702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10db47f175340a1828d888ea9e4cb7a', 'request_id': 'req-0d988ab0-b227-4646-aac9-09fe7709fc7d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:41.027986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00a6e-0080-464f-aee9-baece282132c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.028288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00a6e-0080-464f-aee9-baece282132c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.028580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc00a6e-0080-464f-aee9-baece282132c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.043158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] The token cache is being invalidate because project b10db47f175340a1828d888ea9e4cb7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:41.043581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:41.045183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:41.053668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 945/1912] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:40 2022] DELETE /identity/v3/projects/b10db47f175340a1828d888ea9e4cb7a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:41.055222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.057076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:41.086908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-cdc00a6e-0080-464f-aee9-baece282132c None None] MFA Rules not processed for user `5863c78faf764468979b821c88746aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:41.088149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cdc00a6e-0080-464f-aee9-baece282132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:41.212290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d988ab0-b227-4646-aac9-09fe7709fc7d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.212880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 968/1913] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:41.217710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00a6e-0080-464f-aee9-baece282132c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.220024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cdc00a6e-0080-464f-aee9-baece282132c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:41.225025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.226053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.226476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.227013 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] PATH_INFO: `/v3/users/5f20a60d6f704cf3a0c93272f828950a` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.228376 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f20a60d6f704cf3a0c93272f828950a)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.231022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.244229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc00a6e-0080-464f-aee9-baece282132c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.258562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbf9ee-8410-4719-873b-f5e61cfedee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.259382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbf9ee-8410-4719-873b-f5e61cfedee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.260135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbf9ee-8410-4719-873b-f5e61cfedee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.260694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfbf9ee-8410-4719-873b-f5e61cfedee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.262067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbf9ee-8410-4719-873b-f5e61cfedee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.263408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfbf9ee-8410-4719-873b-f5e61cfedee3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.302961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 969/1914] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:41 2022] POST /identity/v3/projects => generated 393 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:41.304684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbf9ee-8410-4719-873b-f5e61cfedee3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.317979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:41.334574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:41.335512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f20a60d6f704cf3a0c93272f828950a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:41.336375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f20a60d6f704cf3a0c93272f828950a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:41.337176 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f20a60d6f704cf3a0c93272f828950a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:41.358301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f20a60d6f704cf3a0c93272f828950a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:41.367627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f20a60d6f704cf3a0c93272f828950a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:41.389141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 946/1915] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:41 2022] DELETE /identity/v3/users/5f20a60d6f704cf3a0c93272f828950a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:41.444779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfbf9ee-8410-4719-873b-f5e61cfedee3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.524757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297373-32bd-4eab-b931-5c21bf933d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.525444 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297373-32bd-4eab-b931-5c21bf933d51 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.525730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297373-32bd-4eab-b931-5c21bf933d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.526011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe297373-32bd-4eab-b931-5c21bf933d51 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.526753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe297373-32bd-4eab-b931-5c21bf933d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.528915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe297373-32bd-4eab-b931-5c21bf933d51 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.554552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 970/1916] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:41 2022] POST /identity/v3/users => generated 303 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:41.558139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.558139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:41.573369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e9f91-c7f9-4821-9014-55033d8bef9f admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.579593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e0d55-db86-40f9-8611-a11185110b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.580424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e0d55-db86-40f9-8611-a11185110b05 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.580763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e0d55-db86-40f9-8611-a11185110b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.581036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e0d55-db86-40f9-8611-a11185110b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.581770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e0d55-db86-40f9-8611-a11185110b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.583436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e0d55-db86-40f9-8611-a11185110b05 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.595795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 947/1917] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:41.600041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297373-32bd-4eab-b931-5c21bf933d51 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.616178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe297373-32bd-4eab-b931-5c21bf933d51 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.626052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f11059-3c2b-46ad-a98f-aa30d0d8eb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.627072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f11059-3c2b-46ad-a98f-aa30d0d8eb0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.627354 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f11059-3c2b-46ad-a98f-aa30d0d8eb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.627630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f11059-3c2b-46ad-a98f-aa30d0d8eb0c admin admin] PATH_INFO: `/v3/projects/5279a790788b4a83903d1db9e48ebbb6/users/5369ff69c3d443f2a959d37090ae92f8/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.646607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f11059-3c2b-46ad-a98f-aa30d0d8eb0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5279a790788b4a83903d1db9e48ebbb6, user_id=5369ff69c3d443f2a959d37090ae92f8, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.649351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f11059-3c2b-46ad-a98f-aa30d0d8eb0c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.669725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 971/1918] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:41 2022] PUT /identity/v3/projects/5279a790788b4a83903d1db9e48ebbb6/users/5369ff69c3d443f2a959d37090ae92f8/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:41.673690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e0d55-db86-40f9-8611-a11185110b05 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.688956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e0d55-db86-40f9-8611-a11185110b05 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.764695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f159755-f5f2-4c44-8606-4065b839fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.765500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f159755-f5f2-4c44-8606-4065b839fc9c admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.765816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f159755-f5f2-4c44-8606-4065b839fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.766247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f159755-f5f2-4c44-8606-4065b839fc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.767073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f159755-f5f2-4c44-8606-4065b839fc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.769168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f159755-f5f2-4c44-8606-4065b839fc9c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.785084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 948/1919] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:41.785846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f11059-3c2b-46ad-a98f-aa30d0d8eb0c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.800166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f11059-3c2b-46ad-a98f-aa30d0d8eb0c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:41.806714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171880de-a4a7-4935-9813-be8c7dd4437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:41.807628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171880de-a4a7-4935-9813-be8c7dd4437b admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.807912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171880de-a4a7-4935-9813-be8c7dd4437b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.808195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171880de-a4a7-4935-9813-be8c7dd4437b admin admin] PATH_INFO: `/v3/projects/5279a790788b4a83903d1db9e48ebbb6/users/5369ff69c3d443f2a959d37090ae92f8/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.812032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171880de-a4a7-4935-9813-be8c7dd4437b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5279a790788b4a83903d1db9e48ebbb6, user_id=5369ff69c3d443f2a959d37090ae92f8, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:41.816248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171880de-a4a7-4935-9813-be8c7dd4437b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:41.838495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 972/1920] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:41 2022] PUT /identity/v3/projects/5279a790788b4a83903d1db9e48ebbb6/users/5369ff69c3d443f2a959d37090ae92f8/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:41.863760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4b8e-27cf-4db7-85ca-de60af5c7be9 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:41.863760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4b8e-27cf-4db7-85ca-de60af5c7be9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:41.863760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd4b8e-27cf-4db7-85ca-de60af5c7be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:41.876514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171880de-a4a7-4935-9813-be8c7dd4437b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:41.878629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-171880de-a4a7-4935-9813-be8c7dd4437b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:41.889537 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c5fd4b8e-27cf-4db7-85ca-de60af5c7be9 None None] MFA Rules not processed for user `5369ff69c3d443f2a959d37090ae92f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:41.891615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c5fd4b8e-27cf-4db7-85ca-de60af5c7be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:42.006408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 949/1921] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:42.015614 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4b8e-27cf-4db7-85ca-de60af5c7be9 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.017110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c5fd4b8e-27cf-4db7-85ca-de60af5c7be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:42.028941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171880de-a4a7-4935-9813-be8c7dd4437b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.042968 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.044015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.044396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.044885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] PATH_INFO: `/v3/projects/02b2b37c1d10468f89f6ae4cff9ad1d6` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.046103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02b2b37c1d10468f89f6ae4cff9ad1d6)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.048867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.067755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:42.083640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:42.105799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd4b8e-27cf-4db7-85ca-de60af5c7be9 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.122918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02b2b37c1d10468f89f6ae4cff9ad1d6', 'request_id': 'req-dc7cc880-c854-43ad-b50a-67d0b312d868'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:42.135249 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02b2b37c1d10468f89f6ae4cff9ad1d6', 'request_id': 'req-dc7cc880-c854-43ad-b50a-67d0b312d868'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:42.142741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02b2b37c1d10468f89f6ae4cff9ad1d6', 'request_id': 'req-dc7cc880-c854-43ad-b50a-67d0b312d868'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:42.157165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] The token cache is being invalidate because project 02b2b37c1d10468f89f6ae4cff9ad1d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:42.157475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:42.158223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc7cc880-c854-43ad-b50a-67d0b312d868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:42.159876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 973/1922] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:41 2022] DELETE /identity/v3/projects/02b2b37c1d10468f89f6ae4cff9ad1d6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:42.164868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885b9b-228a-4eaf-a711-ae929dd6a117 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.165155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885b9b-228a-4eaf-a711-ae929dd6a117 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.165433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d885b9b-228a-4eaf-a711-ae929dd6a117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.176302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd8c6-2127-4409-96b1-144cd169dc22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.177277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd8c6-2127-4409-96b1-144cd169dc22 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.177702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd8c6-2127-4409-96b1-144cd169dc22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.178185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fd8c6-2127-4409-96b1-144cd169dc22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.180957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-027fd8c6-2127-4409-96b1-144cd169dc22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:42.186492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5d885b9b-228a-4eaf-a711-ae929dd6a117 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:42.187588 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5d885b9b-228a-4eaf-a711-ae929dd6a117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:42.277429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 974/1923] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:42.284129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91be46-7668-49da-899b-f6993150d8d0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.284729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91be46-7668-49da-899b-f6993150d8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.285372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e91be46-7668-49da-899b-f6993150d8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.297554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd8c6-2127-4409-96b1-144cd169dc22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.299351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027fd8c6-2127-4409-96b1-144cd169dc22 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.319380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8e91be46-7668-49da-899b-f6993150d8d0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:42.321449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8e91be46-7668-49da-899b-f6993150d8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:42.323823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 950/1924] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:42.331250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 975/1925] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:42.335268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd8c6-2127-4409-96b1-144cd169dc22 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.352168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027fd8c6-2127-4409-96b1-144cd169dc22 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.370350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91be46-7668-49da-899b-f6993150d8d0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.372458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8e91be46-7668-49da-899b-f6993150d8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:42.372763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c730f-9082-4f99-b929-6defe274df68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.373454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c730f-9082-4f99-b929-6defe274df68 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.373733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c730f-9082-4f99-b929-6defe274df68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.374004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c730f-9082-4f99-b929-6defe274df68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.374831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c730f-9082-4f99-b929-6defe274df68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:42.375133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c730f-9082-4f99-b929-6defe274df68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.376811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c730f-9082-4f99-b929-6defe274df68 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.401312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e91be46-7668-49da-899b-f6993150d8d0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.410897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddb9f9-212f-4720-8f3c-af9c22af804f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.411601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddb9f9-212f-4720-8f3c-af9c22af804f service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.411962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddb9f9-212f-4720-8f3c-af9c22af804f service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.412156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddb9f9-212f-4720-8f3c-af9c22af804f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.414366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-65ddb9f9-212f-4720-8f3c-af9c22af804f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:42.415540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 951/1926] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:42.430108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c730f-9082-4f99-b929-6defe274df68 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.444022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c730f-9082-4f99-b929-6defe274df68 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.449755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7c99d-e04d-4aff-964b-ef19a47bc607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.449998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7c99d-e04d-4aff-964b-ef19a47bc607 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.450398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7c99d-e04d-4aff-964b-ef19a47bc607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.450581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7c99d-e04d-4aff-964b-ef19a47bc607 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.451271 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7c99d-e04d-4aff-964b-ef19a47bc607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.454997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d7c99d-e04d-4aff-964b-ef19a47bc607 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.511484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 952/1927] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:42 2022] POST /identity/v3/projects => generated 371 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:42.517152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7c99d-e04d-4aff-964b-ef19a47bc607 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.555290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddb9f9-212f-4720-8f3c-af9c22af804f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.557541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddb9f9-212f-4720-8f3c-af9c22af804f service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.570156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 976/1928] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:42.604333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:42.611936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7c99d-e04d-4aff-964b-ef19a47bc607 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.619406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d335-a2e3-448a-b04c-6762ee0e9ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.620082 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d335-a2e3-448a-b04c-6762ee0e9ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.620370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d335-a2e3-448a-b04c-6762ee0e9ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.620643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3976d335-a2e3-448a-b04c-6762ee0e9ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.621475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d335-a2e3-448a-b04c-6762ee0e9ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.623522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3976d335-a2e3-448a-b04c-6762ee0e9ee8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.654916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 953/1929] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:42 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:42.659945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddb9f9-212f-4720-8f3c-af9c22af804f service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.683545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddb9f9-212f-4720-8f3c-af9c22af804f service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.691609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1e072-27b0-46ec-9f1c-2e4e14ff2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.693324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1e072-27b0-46ec-9f1c-2e4e14ff2007 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.693931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1e072-27b0-46ec-9f1c-2e4e14ff2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.694662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1e072-27b0-46ec-9f1c-2e4e14ff2007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.696365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1e072-27b0-46ec-9f1c-2e4e14ff2007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.699805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d1e072-27b0-46ec-9f1c-2e4e14ff2007 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.716118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 977/1930] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:42.721870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d335-a2e3-448a-b04c-6762ee0e9ee8 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.733758 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3976d335-a2e3-448a-b04c-6762ee0e9ee8 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.743249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d381a5-fd83-49bc-bd33-16061489c5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.744099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d381a5-fd83-49bc-bd33-16061489c5ca admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.744449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d381a5-fd83-49bc-bd33-16061489c5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.744996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d381a5-fd83-49bc-bd33-16061489c5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.745814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d381a5-fd83-49bc-bd33-16061489c5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.747704 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d381a5-fd83-49bc-bd33-16061489c5ca admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.779174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 954/1931] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:42.780660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1e072-27b0-46ec-9f1c-2e4e14ff2007 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:42.794410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1e072-27b0-46ec-9f1c-2e4e14ff2007 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:42.800109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be02c-23da-40b6-9adc-94b016bd3da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:42.801788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be02c-23da-40b6-9adc-94b016bd3da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.802125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be02c-23da-40b6-9adc-94b016bd3da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.802513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472be02c-23da-40b6-9adc-94b016bd3da3 admin admin] PATH_INFO: `/v3/projects/784b3ceaa4fc47f8a15e5fe927d35bea/users/950c6a8d31ac4464bda197421b221f15/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.821248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472be02c-23da-40b6-9adc-94b016bd3da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784b3ceaa4fc47f8a15e5fe927d35bea, user_id=950c6a8d31ac4464bda197421b221f15, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:42.824174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472be02c-23da-40b6-9adc-94b016bd3da3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:42.839182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 978/1932] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:42 2022] PUT /identity/v3/projects/784b3ceaa4fc47f8a15e5fe927d35bea/users/950c6a8d31ac4464bda197421b221f15/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:42.854135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d734693-1eaa-447f-80ac-11c53b702be8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:42.854425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d734693-1eaa-447f-80ac-11c53b702be8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:42.854704 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d734693-1eaa-447f-80ac-11c53b702be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:42.894799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-4d734693-1eaa-447f-80ac-11c53b702be8 None None] MFA Rules not processed for user `950c6a8d31ac4464bda197421b221f15`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:42.896294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4d734693-1eaa-447f-80ac-11c53b702be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:43.014686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 955/1933] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:43.024311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be02c-23da-40b6-9adc-94b016bd3da3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:43.040792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:43.139116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472be02c-23da-40b6-9adc-94b016bd3da3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.145021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc94ec6-b6af-40cc-82ac-d0378f29348d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:43.145685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc94ec6-b6af-40cc-82ac-d0378f29348d service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.145962 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc94ec6-b6af-40cc-82ac-d0378f29348d service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.146271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc94ec6-b6af-40cc-82ac-d0378f29348d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.159386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc94ec6-b6af-40cc-82ac-d0378f29348d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:43.161550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc94ec6-b6af-40cc-82ac-d0378f29348d service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:43.175427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 979/1934] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:43.202977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d734693-1eaa-447f-80ac-11c53b702be8 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:43.368456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d734693-1eaa-447f-80ac-11c53b702be8 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.374421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:43.375979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.376434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.376795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] PATH_INFO: `/v3/users/950c6a8d31ac4464bda197421b221f15` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.378837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950c6a8d31ac4464bda197421b221f15)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:43.381536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:43.510196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950c6a8d31ac4464bda197421b221f15'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:43.511185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950c6a8d31ac4464bda197421b221f15'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:43.512525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950c6a8d31ac4464bda197421b221f15'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:43.544169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950c6a8d31ac4464bda197421b221f15'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:43.547378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:43.557789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950c6a8d31ac4464bda197421b221f15'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:43.598043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 956/1935] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:43 2022] DELETE /identity/v3/users/950c6a8d31ac4464bda197421b221f15 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:43.602624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be36b4-1ad7-4d69-b240-a482e4a8e22d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.605435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be36b4-1ad7-4d69-b240-a482e4a8e22d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.605704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be36b4-1ad7-4d69-b240-a482e4a8e22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.633598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-71be36b4-1ad7-4d69-b240-a482e4a8e22d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:43.634441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-71be36b4-1ad7-4d69-b240-a482e4a8e22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:43.746001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 980/1936] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:43.770863 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:43.772246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:43.873523 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68720aed-64cb-4a3a-a274-85ad04977765 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:43.879501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb477f95-9c44-43f0-b6e0-c69f42a521e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:43.880237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477f95-9c44-43f0-b6e0-c69f42a521e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:43.880527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477f95-9c44-43f0-b6e0-c69f42a521e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:43.880963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb477f95-9c44-43f0-b6e0-c69f42a521e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:43.891953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb477f95-9c44-43f0-b6e0-c69f42a521e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:43.893696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb477f95-9c44-43f0-b6e0-c69f42a521e0 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:43.908977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 957/1937] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:44.425986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be36b4-1ad7-4d69-b240-a482e4a8e22d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.429265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-71be36b4-1ad7-4d69-b240-a482e4a8e22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:44.446657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be36b4-1ad7-4d69-b240-a482e4a8e22d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.452211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.452984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.453284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.454217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] PATH_INFO: `/v3/projects/784b3ceaa4fc47f8a15e5fe927d35bea` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.455654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784b3ceaa4fc47f8a15e5fe927d35bea)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.458142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:44.545316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784b3ceaa4fc47f8a15e5fe927d35bea', 'request_id': 'req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:44.556028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784b3ceaa4fc47f8a15e5fe927d35bea', 'request_id': 'req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:44.565970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784b3ceaa4fc47f8a15e5fe927d35bea', 'request_id': 'req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:44.578742 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] The token cache is being invalidate because project 784b3ceaa4fc47f8a15e5fe927d35bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:44.579038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:44.579760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-0adaa8a9-62b8-4af0-9be1-c9a8f474dd10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:44.581467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 981/1938] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:44 2022] DELETE /identity/v3/projects/784b3ceaa4fc47f8a15e5fe927d35bea => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:44.586665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162be98a-fe79-4e0b-907f-aaa354f6bf35 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.586958 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162be98a-fe79-4e0b-907f-aaa354f6bf35 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.587713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162be98a-fe79-4e0b-907f-aaa354f6bf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.613584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-162be98a-fe79-4e0b-907f-aaa354f6bf35 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:44.614277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-162be98a-fe79-4e0b-907f-aaa354f6bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:44.705290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 958/1939] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:44.714064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d995-2a2a-4d2b-be15-03fdd54eb188 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.714698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d995-2a2a-4d2b-be15-03fdd54eb188 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.714698 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d995-2a2a-4d2b-be15-03fdd54eb188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.739116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5ed8d995-2a2a-4d2b-be15-03fdd54eb188 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:44.740388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5ed8d995-2a2a-4d2b-be15-03fdd54eb188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:44.756834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162be98a-fe79-4e0b-907f-aaa354f6bf35 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.766130 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 982/1940] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:44.774848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162be98a-fe79-4e0b-907f-aaa354f6bf35 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.780490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a176-d736-4ddc-8c58-b2617f051f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.782479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a176-d736-4ddc-8c58-b2617f051f3e admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.782479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a176-d736-4ddc-8c58-b2617f051f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.782933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be93a176-d736-4ddc-8c58-b2617f051f3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.783578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93a176-d736-4ddc-8c58-b2617f051f3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:44.784035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93a176-d736-4ddc-8c58-b2617f051f3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.785680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be93a176-d736-4ddc-8c58-b2617f051f3e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:44.807137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 959/1941] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:44.811878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8d995-2a2a-4d2b-be15-03fdd54eb188 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.821630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8d995-2a2a-4d2b-be15-03fdd54eb188 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.827372 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893457f-7a98-4a8a-a62b-571d46405581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.830433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893457f-7a98-4a8a-a62b-571d46405581 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.830715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893457f-7a98-4a8a-a62b-571d46405581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.831095 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893457f-7a98-4a8a-a62b-571d46405581 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.831674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893457f-7a98-4a8a-a62b-571d46405581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.833595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893457f-7a98-4a8a-a62b-571d46405581 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:44.882883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 983/1942] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:44 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:43:44.884090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a176-d736-4ddc-8c58-b2617f051f3e admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:44.896620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be93a176-d736-4ddc-8c58-b2617f051f3e admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:44.989767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e862623-89b8-4714-8543-1fc979e1f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:44.991194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e862623-89b8-4714-8543-1fc979e1f639 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:44.991483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e862623-89b8-4714-8543-1fc979e1f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:44.991765 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e862623-89b8-4714-8543-1fc979e1f639 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:44.992586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e862623-89b8-4714-8543-1fc979e1f639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:44.995275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e862623-89b8-4714-8543-1fc979e1f639 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.040153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 960/1943] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:44 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:45.041833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893457f-7a98-4a8a-a62b-571d46405581 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:45.049662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:45.060921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893457f-7a98-4a8a-a62b-571d46405581 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:45.072066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f499c5-63cb-43a9-88d8-090722d8452f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:45.073284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f499c5-63cb-43a9-88d8-090722d8452f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.073989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f499c5-63cb-43a9-88d8-090722d8452f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.074478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f499c5-63cb-43a9-88d8-090722d8452f admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.075439 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f499c5-63cb-43a9-88d8-090722d8452f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:45.077633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f499c5-63cb-43a9-88d8-090722d8452f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.110488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 984/1944] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:45.114208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e862623-89b8-4714-8543-1fc979e1f639 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:45.129990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:45.142575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e862623-89b8-4714-8543-1fc979e1f639 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:45.179968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8ecec-5fde-45d4-9b16-49aead8e248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:45.180796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8ecec-5fde-45d4-9b16-49aead8e248f admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.181085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8ecec-5fde-45d4-9b16-49aead8e248f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.181361 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8ecec-5fde-45d4-9b16-49aead8e248f admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.191058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8ecec-5fde-45d4-9b16-49aead8e248f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:45.196531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8ecec-5fde-45d4-9b16-49aead8e248f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.229632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 961/1945] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:45.229891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f499c5-63cb-43a9-88d8-090722d8452f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:45.250558 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f499c5-63cb-43a9-88d8-090722d8452f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:45.258390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ad0ce-38ba-47da-b58d-f6899f8079f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:45.259566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ad0ce-38ba-47da-b58d-f6899f8079f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.259855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ad0ce-38ba-47da-b58d-f6899f8079f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.260136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ad0ce-38ba-47da-b58d-f6899f8079f6 admin admin] PATH_INFO: `/v3/projects/5d503a37c92648158a42c70234cb45ca/users/f838249fe466445b8390013bad0be94a/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.286248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ad0ce-38ba-47da-b58d-f6899f8079f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d503a37c92648158a42c70234cb45ca, user_id=f838249fe466445b8390013bad0be94a, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:45.288040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ad0ce-38ba-47da-b58d-f6899f8079f6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.313500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 985/1946] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:45 2022] PUT /identity/v3/projects/5d503a37c92648158a42c70234cb45ca/users/f838249fe466445b8390013bad0be94a/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:45.315195 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925f3b-a170-4dc3-96be-d6bff1a0301a None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.315491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925f3b-a170-4dc3-96be-d6bff1a0301a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.315836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b925f3b-a170-4dc3-96be-d6bff1a0301a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.367855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-8b925f3b-a170-4dc3-96be-d6bff1a0301a None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:45.369346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8b925f3b-a170-4dc3-96be-d6bff1a0301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:45.508341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 962/1947] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:45.548520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ad0ce-38ba-47da-b58d-f6899f8079f6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:45.551290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-769ad0ce-38ba-47da-b58d-f6899f8079f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:45.586730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925f3b-a170-4dc3-96be-d6bff1a0301a None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:45.588312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8b925f3b-a170-4dc3-96be-d6bff1a0301a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:45.613397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b925f3b-a170-4dc3-96be-d6bff1a0301a None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:45.626990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:45.627898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.628180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.628469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] PATH_INFO: `/v3/users/e5b2f2d1d5b84ceb92afc41624795f82` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.630010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b2f2d1d5b84ceb92afc41624795f82)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:45.632397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.663651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ad0ce-38ba-47da-b58d-f6899f8079f6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:45.668252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf2e25-c4c5-42ee-b633-d6678d623522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:45.669011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2e25-c4c5-42ee-b633-d6678d623522 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.669375 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2e25-c4c5-42ee-b633-d6678d623522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.669729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf2e25-c4c5-42ee-b633-d6678d623522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.683918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf2e25-c4c5-42ee-b633-d6678d623522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:45.685929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf2e25-c4c5-42ee-b633-d6678d623522 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:45.706827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 986/1948] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:45.722922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b2f2d1d5b84ceb92afc41624795f82'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:45.723633 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b2f2d1d5b84ceb92afc41624795f82'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:45.724933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b2f2d1d5b84ceb92afc41624795f82'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:45.742377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b2f2d1d5b84ceb92afc41624795f82'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:45.752375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b2f2d1d5b84ceb92afc41624795f82'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:45.778169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 963/1949] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:45 2022] DELETE /identity/v3/users/e5b2f2d1d5b84ceb92afc41624795f82 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:45.783577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1bf7-df32-4f7c-81c9-23124a35a6a8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:45.784038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1bf7-df32-4f7c-81c9-23124a35a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:45.784330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f1bf7-df32-4f7c-81c9-23124a35a6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:45.814238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-fd1f1bf7-df32-4f7c-81c9-23124a35a6a8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:45.816567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fd1f1bf7-df32-4f7c-81c9-23124a35a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:45.937885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 987/1950] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:45.973994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:45.977599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:46.104261 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb51be-0761-4b00-b575-29e33d825c86 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:46.119495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673ead6-ec4b-4923-a6a7-f96ef23b950d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:46.120334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673ead6-ec4b-4923-a6a7-f96ef23b950d service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:46.120620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673ead6-ec4b-4923-a6a7-f96ef23b950d service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:46.121122 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673ead6-ec4b-4923-a6a7-f96ef23b950d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:46.133134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673ead6-ec4b-4923-a6a7-f96ef23b950d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:46.134638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673ead6-ec4b-4923-a6a7-f96ef23b950d service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:46.159692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 964/1951] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:46.813272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1bf7-df32-4f7c-81c9-23124a35a6a8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:46.815618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fd1f1bf7-df32-4f7c-81c9-23124a35a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:46.829922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f1bf7-df32-4f7c-81c9-23124a35a6a8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:46.835645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:46.837128 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:46.837594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:46.838060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] PATH_INFO: `/v3/users/5863c78faf764468979b821c88746aa5` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:46.839897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5863c78faf764468979b821c88746aa5)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:46.842620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:46.927585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5863c78faf764468979b821c88746aa5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:46.941379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5863c78faf764468979b821c88746aa5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:46.942875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5863c78faf764468979b821c88746aa5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:46.965140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673ead6-ec4b-4923-a6a7-f96ef23b950d service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:46.968285 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e673ead6-ec4b-4923-a6a7-f96ef23b950d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:46.975138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:46.979905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5863c78faf764468979b821c88746aa5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:46.993998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f5cc28c4-06ac-4e39-8e4c-7ce5d295424d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5863c78faf764468979b821c88746aa5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:46.997447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673ead6-ec4b-4923-a6a7-f96ef23b950d service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:47.022536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 988/1952] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:46 2022] DELETE /identity/v3/users/5863c78faf764468979b821c88746aa5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:47.024080 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cc849-8ad4-48e5-9aff-393286c13d97 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.024640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cc849-8ad4-48e5-9aff-393286c13d97 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.025136 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48cc849-8ad4-48e5-9aff-393286c13d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.029140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:47.036941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.037232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.037749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] PATH_INFO: `/v3/projects/92d24c0f9b0f4ef4b3aae354684d9d55` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.039342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d24c0f9b0f4ef4b3aae354684d9d55)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:47.041674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:47.044893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:47.051104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f48cc849-8ad4-48e5-9aff-393286c13d97 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:47.052852 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f48cc849-8ad4-48e5-9aff-393286c13d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:47.121412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d24c0f9b0f4ef4b3aae354684d9d55', 'request_id': 'req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:47.134247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d24c0f9b0f4ef4b3aae354684d9d55', 'request_id': 'req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:47.143205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d24c0f9b0f4ef4b3aae354684d9d55', 'request_id': 'req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:47.146662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 989/1953] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:47.153756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cc849-8ad4-48e5-9aff-393286c13d97 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:47.155407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f48cc849-8ad4-48e5-9aff-393286c13d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:47.157750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] The token cache is being invalidate because project 92d24c0f9b0f4ef4b3aae354684d9d55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:47.158233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:47.158828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:47.161296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 965/1954] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:46 2022] DELETE /identity/v3/projects/92d24c0f9b0f4ef4b3aae354684d9d55 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:47.165617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:47.167152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:47.241582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48cc849-8ad4-48e5-9aff-393286c13d97 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:47.257339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef4952e-f094-42a1-a40f-3a21d3f7aec9 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:47.263810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:47.264710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.265267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.265541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] PATH_INFO: `/v3/users/6cbff02296f547aeb5b3d2bd250a09b1` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.266918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbff02296f547aeb5b3d2bd250a09b1)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:47.269206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:47.309700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffefdd7-2894-44d5-a88b-e4cfed43fed4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:47.310457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffefdd7-2894-44d5-a88b-e4cfed43fed4 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.310783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffefdd7-2894-44d5-a88b-e4cfed43fed4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.311026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffefdd7-2894-44d5-a88b-e4cfed43fed4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.313884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1ffefdd7-2894-44d5-a88b-e4cfed43fed4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:47.330832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffefdd7-2894-44d5-a88b-e4cfed43fed4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:47.333882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffefdd7-2894-44d5-a88b-e4cfed43fed4 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:47.335438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbff02296f547aeb5b3d2bd250a09b1'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:47.336451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbff02296f547aeb5b3d2bd250a09b1'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:47.337275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbff02296f547aeb5b3d2bd250a09b1'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:47.355586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbff02296f547aeb5b3d2bd250a09b1'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:47.375164 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 990/1955] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:47.376402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83cedc-dd9e-411d-8a60-0e6e3c2c22bc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.376756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83cedc-dd9e-411d-8a60-0e6e3c2c22bc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.376961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83cedc-dd9e-411d-8a60-0e6e3c2c22bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.383130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbff02296f547aeb5b3d2bd250a09b1'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:47.409750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 966/1956] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:47 2022] DELETE /identity/v3/users/6cbff02296f547aeb5b3d2bd250a09b1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:47.435584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bb83cedc-dd9e-411d-8a60-0e6e3c2c22bc None None] MFA Rules not processed for user `f838249fe466445b8390013bad0be94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:47.436928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bb83cedc-dd9e-411d-8a60-0e6e3c2c22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:47.480047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:47.540506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 991/1957] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:47.554240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:47.555908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:47.569977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:47.636300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e821119-ad0c-42ae-aa42-cde1ceb24edd admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:47.640545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a42319-d899-4a03-bd50-c74920d32b46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:47.641233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a42319-d899-4a03-bd50-c74920d32b46 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.641504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a42319-d899-4a03-bd50-c74920d32b46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.641789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a42319-d899-4a03-bd50-c74920d32b46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.651491 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a42319-d899-4a03-bd50-c74920d32b46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:47.653525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a42319-d899-4a03-bd50-c74920d32b46 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:47.665237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 967/1958] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:47.762963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83cedc-dd9e-411d-8a60-0e6e3c2c22bc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:47.764601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bb83cedc-dd9e-411d-8a60-0e6e3c2c22bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:47.888445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83cedc-dd9e-411d-8a60-0e6e3c2c22bc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:47.901522 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:47.902641 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:47.902835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:47.903171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] PATH_INFO: `/v3/projects/cbb8d2cdb2e441e096ba0e189e37acce` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:47.905067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbb8d2cdb2e441e096ba0e189e37acce)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:47.907620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:48.047203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbb8d2cdb2e441e096ba0e189e37acce', 'request_id': 'req-59ddd122-921e-414b-93cd-1b57742e7955'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.062321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbb8d2cdb2e441e096ba0e189e37acce', 'request_id': 'req-59ddd122-921e-414b-93cd-1b57742e7955'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.073077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbb8d2cdb2e441e096ba0e189e37acce', 'request_id': 'req-59ddd122-921e-414b-93cd-1b57742e7955'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.095377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] The token cache is being invalidate because project cbb8d2cdb2e441e096ba0e189e37acce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:48.095884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.096780 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.102065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 992/1959] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:47 2022] DELETE /identity/v3/projects/cbb8d2cdb2e441e096ba0e189e37acce => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:48.103600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a42319-d899-4a03-bd50-c74920d32b46 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:48.127538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a42319-d899-4a03-bd50-c74920d32b46 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:48.167222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:48.168818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:48.274503 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ddd122-921e-414b-93cd-1b57742e7955 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:48.289226 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:48.291426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:48.291734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:48.292019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] PATH_INFO: `/v3/projects/aeec52b77bc64aed9502283679e3dcdd` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:48.295401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeec52b77bc64aed9502283679e3dcdd)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:48.301268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:48.316666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:48.323165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:48.333163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:48.333653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:48.334124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] PATH_INFO: `/v3/users/6a57fab9144c41f0a72cb87f73866d04` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:48.337835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a57fab9144c41f0a72cb87f73866d04)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:48.342001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:48.443989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a57fab9144c41f0a72cb87f73866d04'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.444795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a57fab9144c41f0a72cb87f73866d04'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.445448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a57fab9144c41f0a72cb87f73866d04'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.451090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeec52b77bc64aed9502283679e3dcdd', 'request_id': 'req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.462974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeec52b77bc64aed9502283679e3dcdd', 'request_id': 'req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.470702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a57fab9144c41f0a72cb87f73866d04'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.481174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a57fab9144c41f0a72cb87f73866d04'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.491083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeec52b77bc64aed9502283679e3dcdd', 'request_id': 'req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.504363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] The token cache is being invalidate because project aeec52b77bc64aed9502283679e3dcdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:48.504775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.505528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.507565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 993/1960] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:48 2022] DELETE /identity/v3/projects/aeec52b77bc64aed9502283679e3dcdd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:48.515676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:48.518832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 968/1961] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:48 2022] DELETE /identity/v3/users/6a57fab9144c41f0a72cb87f73866d04 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:48.521828 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:48.659338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ec3bf-263b-48c6-b6b6-9873f81de3bb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:48.737134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:48.738149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:48.739290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:48.739728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] PATH_INFO: `/v3/users/5369ff69c3d443f2a959d37090ae92f8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:48.741395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5369ff69c3d443f2a959d37090ae92f8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:48.743555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:48.846948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:48.856242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5369ff69c3d443f2a959d37090ae92f8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.881817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5369ff69c3d443f2a959d37090ae92f8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.883158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5369ff69c3d443f2a959d37090ae92f8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.907896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5369ff69c3d443f2a959d37090ae92f8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.919194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5369ff69c3d443f2a959d37090ae92f8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:48.929029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 994/1962] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:48 2022] DELETE /identity/v3/users/5369ff69c3d443f2a959d37090ae92f8 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:48.935750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:48.937981 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:48.992651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f909755-09e8-402c-b250-a16aa13a72c8 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.057545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:49.101073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.102547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.103033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.103454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] PATH_INFO: `/v3/projects/6c3f1114bb3249bcb0a50c24a9abece3` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.106664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3f1114bb3249bcb0a50c24a9abece3)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.109583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.184814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3f1114bb3249bcb0a50c24a9abece3', 'request_id': 'req-c524fe29-4005-4f37-8139-e8f15c516105'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.195087 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.198450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.213123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3f1114bb3249bcb0a50c24a9abece3', 'request_id': 'req-c524fe29-4005-4f37-8139-e8f15c516105'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.225626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b2923-1123-4228-8b1c-c538bf5a61f7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.243329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3f1114bb3249bcb0a50c24a9abece3', 'request_id': 'req-c524fe29-4005-4f37-8139-e8f15c516105'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.261823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] The token cache is being invalidate because project 6c3f1114bb3249bcb0a50c24a9abece3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:49.261823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.262726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c524fe29-4005-4f37-8139-e8f15c516105 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.264769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 969/1963] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:48 2022] DELETE /identity/v3/projects/6c3f1114bb3249bcb0a50c24a9abece3 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:49.271034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771b3b-6969-4426-b5a8-f941d15dc56f None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.271537 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771b3b-6969-4426-b5a8-f941d15dc56f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.271999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94771b3b-6969-4426-b5a8-f941d15dc56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.297767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-94771b3b-6969-4426-b5a8-f941d15dc56f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:49.299041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-94771b3b-6969-4426-b5a8-f941d15dc56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.341920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.343330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.344742 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.345032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] PATH_INFO: `/v3/users/328ff52c19764f788fa544ecefe83733` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.347064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=328ff52c19764f788fa544ecefe83733)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.349051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.384248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 970/1964] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:49.391746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeccb97-3238-45f7-901d-f11f1325ffc1 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.392033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeccb97-3238-45f7-901d-f11f1325ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.392497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeccb97-3238-45f7-901d-f11f1325ffc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.426399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '328ff52c19764f788fa544ecefe83733'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.435601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-baeccb97-3238-45f7-901d-f11f1325ffc1 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:49.437723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '328ff52c19764f788fa544ecefe83733'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.438518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-baeccb97-3238-45f7-901d-f11f1325ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.440258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '328ff52c19764f788fa544ecefe83733'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.450276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 971/1965] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:49.452664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11d1f4-66f9-491b-aad6-35eb3c0b69a6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.453486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11d1f4-66f9-491b-aad6-35eb3c0b69a6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.454506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11d1f4-66f9-491b-aad6-35eb3c0b69a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.463278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '328ff52c19764f788fa544ecefe83733'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.472325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '328ff52c19764f788fa544ecefe83733'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.478999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 995/1966] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:49 2022] DELETE /identity/v3/users/328ff52c19764f788fa544ecefe83733 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:49.479859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.486843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-8c11d1f4-66f9-491b-aad6-35eb3c0b69a6 None None] MFA Rules not processed for user `f838249fe466445b8390013bad0be94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:49.487483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.488239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8c11d1f4-66f9-491b-aad6-35eb3c0b69a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.553186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:49.601258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:49.604267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b821f-c534-44ae-8734-26e60e804bf4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.611252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0026c-fb95-4b80-a2c7-26cc3b29e20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.612374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0026c-fb95-4b80-a2c7-26cc3b29e20c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.612374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0026c-fb95-4b80-a2c7-26cc3b29e20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.612647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0026c-fb95-4b80-a2c7-26cc3b29e20c admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.613329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0026c-fb95-4b80-a2c7-26cc3b29e20c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:49.613738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0026c-fb95-4b80-a2c7-26cc3b29e20c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.615686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0026c-fb95-4b80-a2c7-26cc3b29e20c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.622545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 972/1967] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:49.623492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11d1f4-66f9-491b-aad6-35eb3c0b69a6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.626429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8c11d1f4-66f9-491b-aad6-35eb3c0b69a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.644964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11d1f4-66f9-491b-aad6-35eb3c0b69a6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.652511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.654336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 996/1968] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:49.657794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.658257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0026c-fb95-4b80-a2c7-26cc3b29e20c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.658421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.659224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] PATH_INFO: `/v3/projects/5279a790788b4a83903d1db9e48ebbb6` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.668113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5279a790788b4a83903d1db9e48ebbb6)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.672361 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.681090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0026c-fb95-4b80-a2c7-26cc3b29e20c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.686598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509824e-8945-47ea-9e1e-4df0cc3bde37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.687663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509824e-8945-47ea-9e1e-4df0cc3bde37 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.688049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509824e-8945-47ea-9e1e-4df0cc3bde37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.688379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509824e-8945-47ea-9e1e-4df0cc3bde37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.689182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509824e-8945-47ea-9e1e-4df0cc3bde37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.692285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509824e-8945-47ea-9e1e-4df0cc3bde37 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.751968 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 997/1969] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:49 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:49.756401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509824e-8945-47ea-9e1e-4df0cc3bde37 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.760883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5279a790788b4a83903d1db9e48ebbb6', 'request_id': 'req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.777100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5279a790788b4a83903d1db9e48ebbb6', 'request_id': 'req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.787041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5279a790788b4a83903d1db9e48ebbb6', 'request_id': 'req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.820880 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] The token cache is being invalidate because project 5279a790788b4a83903d1db9e48ebbb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:49.820880 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.822357 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f81865ae-43d2-49f0-9aea-9eef8c14cb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:49.825017 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 973/1970] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:49 2022] DELETE /identity/v3/projects/5279a790788b4a83903d1db9e48ebbb6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:49.831365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71288a81-191f-4e2b-af9e-684126ef54d7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.832320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71288a81-191f-4e2b-af9e-684126ef54d7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.832710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71288a81-191f-4e2b-af9e-684126ef54d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.868066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-71288a81-191f-4e2b-af9e-684126ef54d7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:49.871238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-71288a81-191f-4e2b-af9e-684126ef54d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.874703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509824e-8945-47ea-9e1e-4df0cc3bde37 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.884700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b38b14-5294-4d42-a579-26b4a6d5c165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.885000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 974/1971] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:49.885551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b38b14-5294-4d42-a579-26b4a6d5c165 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.885882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b38b14-5294-4d42-a579-26b4a6d5c165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.886197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b38b14-5294-4d42-a579-26b4a6d5c165 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.887701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b38b14-5294-4d42-a579-26b4a6d5c165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.889140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b38b14-5294-4d42-a579-26b4a6d5c165 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.894144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7b69-8c3b-47d6-b900-910cda9282cd None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.894666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7b69-8c3b-47d6-b900-910cda9282cd None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.895214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a7b69-8c3b-47d6-b900-910cda9282cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.925251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 998/1972] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:49 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:49.926074 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-706a7b69-8c3b-47d6-b900-910cda9282cd None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:49.927340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-706a7b69-8c3b-47d6-b900-910cda9282cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.929271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b38b14-5294-4d42-a579-26b4a6d5c165 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.934523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c2b38b14-5294-4d42-a579-26b4a6d5c165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.946644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b38b14-5294-4d42-a579-26b4a6d5c165 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.949923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 975/1973] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:49.951823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a7b69-8c3b-47d6-b900-910cda9282cd None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.955426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c6d6e-f0b1-4099-9589-272992205302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.956044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c6d6e-f0b1-4099-9589-272992205302 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.956337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c6d6e-f0b1-4099-9589-272992205302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.956622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c6d6e-f0b1-4099-9589-272992205302 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.957363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c6d6e-f0b1-4099-9589-272992205302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.958779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-706a7b69-8c3b-47d6-b900-910cda9282cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:49.959029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c6d6e-f0b1-4099-9589-272992205302 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.977748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 999/1974] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:49.978571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c6d6e-f0b1-4099-9589-272992205302 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:49.985793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a7b69-8c3b-47d6-b900-910cda9282cd None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.990672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c6d6e-f0b1-4099-9589-272992205302 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:49.991030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.992269 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.992643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.993108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] PATH_INFO: `/v3/projects/3c194983b53d4d5dbf50139065be99c0` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.994673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c194983b53d4d5dbf50139065be99c0)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:49.997009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d8f81-fcbc-458d-9b69-8782205907a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:49.997763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d8f81-fcbc-458d-9b69-8782205907a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:49.997949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:49.998220 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d8f81-fcbc-458d-9b69-8782205907a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:49.998571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11d8f81-fcbc-458d-9b69-8782205907a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:49.999507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d8f81-fcbc-458d-9b69-8782205907a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:50.000345 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d8f81-fcbc-458d-9b69-8782205907a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.001944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11d8f81-fcbc-458d-9b69-8782205907a2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.015284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1000/1975] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:50.019066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d8f81-fcbc-458d-9b69-8782205907a2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.031638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11d8f81-fcbc-458d-9b69-8782205907a2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.037262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f276c19-fec1-4f10-84d1-135eb4d9a64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.038110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f276c19-fec1-4f10-84d1-135eb4d9a64d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.042394 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f276c19-fec1-4f10-84d1-135eb4d9a64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.043957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f276c19-fec1-4f10-84d1-135eb4d9a64d admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.045013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f276c19-fec1-4f10-84d1-135eb4d9a64d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.048231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f276c19-fec1-4f10-84d1-135eb4d9a64d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.070234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1001/1976] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:50.070234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f276c19-fec1-4f10-84d1-135eb4d9a64d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.070518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c194983b53d4d5dbf50139065be99c0', 'request_id': 'req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:50.081403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c194983b53d4d5dbf50139065be99c0', 'request_id': 'req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:50.085820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f276c19-fec1-4f10-84d1-135eb4d9a64d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.090729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c194983b53d4d5dbf50139065be99c0', 'request_id': 'req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:50.106012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] The token cache is being invalidate because project 3c194983b53d4d5dbf50139065be99c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:50.106494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:50.107217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:50.112976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 976/1977] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:49 2022] DELETE /identity/v3/projects/3c194983b53d4d5dbf50139065be99c0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:50.113920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.115636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:50.162883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d3169d-4369-4166-80b7-a9f7dda9f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.163560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3169d-4369-4166-80b7-a9f7dda9f971 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.163898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3169d-4369-4166-80b7-a9f7dda9f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.164264 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d3169d-4369-4166-80b7-a9f7dda9f971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.164853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3169d-4369-4166-80b7-a9f7dda9f971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.167198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d3169d-4369-4166-80b7-a9f7dda9f971 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.179084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:50.182129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:50.198916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d15e40-429e-4a0c-b4a4-4d4493ec3702 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.201531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1002/1978] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/projects => generated 399 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:50.202978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d442860-bd4f-442c-b5e6-7dc9c18c4231 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.203450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d442860-bd4f-442c-b5e6-7dc9c18c4231 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.203573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d442860-bd4f-442c-b5e6-7dc9c18c4231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.224115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1d442860-bd4f-442c-b5e6-7dc9c18c4231 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:50.225324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1d442860-bd4f-442c-b5e6-7dc9c18c4231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:50.281689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a6a4b-c560-42d6-8034-28853ef18a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.282691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6a4b-c560-42d6-8034-28853ef18a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.283304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6a4b-c560-42d6-8034-28853ef18a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.283427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a6a4b-c560-42d6-8034-28853ef18a96 admin admin] PATH_INFO: `/v3/projects/aeefd3bf1330475998743f2a7561aca2/users/83722d9ffa5c41d292c56a66ebbd8d17/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.303577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a6a4b-c560-42d6-8034-28853ef18a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeefd3bf1330475998743f2a7561aca2, user_id=83722d9ffa5c41d292c56a66ebbd8d17, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.306405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a6a4b-c560-42d6-8034-28853ef18a96 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.309433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1003/1979] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:50.310469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d442860-bd4f-442c-b5e6-7dc9c18c4231 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.313788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1d442860-bd4f-442c-b5e6-7dc9c18c4231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:50.328329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d442860-bd4f-442c-b5e6-7dc9c18c4231 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.331240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 977/1980] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:50 2022] PUT /identity/v3/projects/aeefd3bf1330475998743f2a7561aca2/users/83722d9ffa5c41d292c56a66ebbd8d17/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:50.332739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff32239-919b-4c19-8bd8-9f758e6d6e96 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.333841 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff32239-919b-4c19-8bd8-9f758e6d6e96 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.334229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff32239-919b-4c19-8bd8-9f758e6d6e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.368151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-aff32239-919b-4c19-8bd8-9f758e6d6e96 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:50.369591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-aff32239-919b-4c19-8bd8-9f758e6d6e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:50.419916 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5207640-eeee-44f6-abf7-a23c1b3f2a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.426055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5207640-eeee-44f6-abf7-a23c1b3f2a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.426459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5207640-eeee-44f6-abf7-a23c1b3f2a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.426805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5207640-eeee-44f6-abf7-a23c1b3f2a8f admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.427621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5207640-eeee-44f6-abf7-a23c1b3f2a8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.429767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5207640-eeee-44f6-abf7-a23c1b3f2a8f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.460584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1004/1981] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:50.460584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4920d-c24b-4e22-9077-7341b4f5bd12 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.461123 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4920d-c24b-4e22-9077-7341b4f5bd12 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.461476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4920d-c24b-4e22-9077-7341b4f5bd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.516073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 978/1982] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:50.517036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff32239-919b-4c19-8bd8-9f758e6d6e96 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.528518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff32239-919b-4c19-8bd8-9f758e6d6e96 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.528940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2dc4920d-c24b-4e22-9077-7341b4f5bd12 None None] MFA Rules not processed for user `83722d9ffa5c41d292c56a66ebbd8d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:50.530331 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2dc4920d-c24b-4e22-9077-7341b4f5bd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:50.535182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5e6b3-4068-4e32-9799-097c30006db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.536764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5e6b3-4068-4e32-9799-097c30006db9 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.537350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5e6b3-4068-4e32-9799-097c30006db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.537810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5e6b3-4068-4e32-9799-097c30006db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.538583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5e6b3-4068-4e32-9799-097c30006db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.541065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b5e6b3-4068-4e32-9799-097c30006db9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.557112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 979/1983] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:50.558731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5e6b3-4068-4e32-9799-097c30006db9 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.571029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5e6b3-4068-4e32-9799-097c30006db9 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.579157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111398d-770c-49f2-a5d4-ee40cf95ac46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.580129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111398d-770c-49f2-a5d4-ee40cf95ac46 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.580699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111398d-770c-49f2-a5d4-ee40cf95ac46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.581197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111398d-770c-49f2-a5d4-ee40cf95ac46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.582134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111398d-770c-49f2-a5d4-ee40cf95ac46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:50.582670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111398d-770c-49f2-a5d4-ee40cf95ac46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.585184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111398d-770c-49f2-a5d4-ee40cf95ac46 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.619089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 980/1984] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:43:50.620456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111398d-770c-49f2-a5d4-ee40cf95ac46 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.643629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111398d-770c-49f2-a5d4-ee40cf95ac46 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.650881 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed7f8e-927b-4e53-adee-e64d6822c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.651831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed7f8e-927b-4e53-adee-e64d6822c425 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.652224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed7f8e-927b-4e53-adee-e64d6822c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.652778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed7f8e-927b-4e53-adee-e64d6822c425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.653725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed7f8e-927b-4e53-adee-e64d6822c425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.656298 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed7f8e-927b-4e53-adee-e64d6822c425 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.678716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 981/1985] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:50.682812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed7f8e-927b-4e53-adee-e64d6822c425 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.698644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1005/1986] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:50.699306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed7f8e-927b-4e53-adee-e64d6822c425 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.702235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4920d-c24b-4e22-9077-7341b4f5bd12 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.716370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4920d-c24b-4e22-9077-7341b4f5bd12 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.718218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26d883-e406-4b02-bef6-19a237a8ee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.719477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26d883-e406-4b02-bef6-19a237a8ee1e admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.719796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26d883-e406-4b02-bef6-19a237a8ee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.720146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb26d883-e406-4b02-bef6-19a237a8ee1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.720913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26d883-e406-4b02-bef6-19a237a8ee1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.723199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb26d883-e406-4b02-bef6-19a237a8ee1e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.723422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bed390-6e1b-4f53-a115-ecf25d42c242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.724937 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bed390-6e1b-4f53-a115-ecf25d42c242 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.725763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bed390-6e1b-4f53-a115-ecf25d42c242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.726051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bed390-6e1b-4f53-a115-ecf25d42c242 admin admin] PATH_INFO: `/v3/projects/13b7d669106a429dbf4c0265dfae1146/users/0c91463aa4ab4881bf76bf57c79f507d/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.736484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:50.746997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bed390-6e1b-4f53-a115-ecf25d42c242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b7d669106a429dbf4c0265dfae1146, user_id=0c91463aa4ab4881bf76bf57c79f507d, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.750920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bed390-6e1b-4f53-a115-ecf25d42c242 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.764716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 982/1987] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:50.770146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26d883-e406-4b02-bef6-19a237a8ee1e admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.772624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fb26d883-e406-4b02-bef6-19a237a8ee1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:50.784747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1006/1988] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:50 2022] PUT /identity/v3/projects/13b7d669106a429dbf4c0265dfae1146/users/0c91463aa4ab4881bf76bf57c79f507d/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:50.785584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bed390-6e1b-4f53-a115-ecf25d42c242 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:50.825672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:50.896074 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb26d883-e406-4b02-bef6-19a237a8ee1e admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.901757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bed390-6e1b-4f53-a115-ecf25d42c242 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:50.909178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb19c5-6d98-4505-87b9-aa6dd5e4f7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.910656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb19c5-6d98-4505-87b9-aa6dd5e4f7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.911380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb19c5-6d98-4505-87b9-aa6dd5e4f7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.912097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb19c5-6d98-4505-87b9-aa6dd5e4f7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.913409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb19c5-6d98-4505-87b9-aa6dd5e4f7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:50.916295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb19c5-6d98-4505-87b9-aa6dd5e4f7e9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:50.951287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1007/1989] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:50.954449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b819b-59fb-4783-8827-5a3962384d22 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.954907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b819b-59fb-4783-8827-5a3962384d22 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.955428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5b819b-59fb-4783-8827-5a3962384d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.980223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57a0d7-0659-4acd-bc25-2480ce32f544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:50.980975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a0d7-0659-4acd-bc25-2480ce32f544 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:50.981329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a0d7-0659-4acd-bc25-2480ce32f544 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:50.981692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57a0d7-0659-4acd-bc25-2480ce32f544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:50.994346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bd5b819b-59fb-4783-8827-5a3962384d22 None None] MFA Rules not processed for user `0c91463aa4ab4881bf76bf57c79f507d`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:50.996345 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bd5b819b-59fb-4783-8827-5a3962384d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:51.079996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57a0d7-0659-4acd-bc25-2480ce32f544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.082281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57a0d7-0659-4acd-bc25-2480ce32f544 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.083057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1008/1990] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:51.084286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b819b-59fb-4783-8827-5a3962384d22 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.097817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 983/1991] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:51.098840 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57a0d7-0659-4acd-bc25-2480ce32f544 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.102334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5b819b-59fb-4783-8827-5a3962384d22 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.109092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af73d16-ffbd-465d-a5f0-10b9a41075f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.109888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af73d16-ffbd-465d-a5f0-10b9a41075f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.110207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af73d16-ffbd-465d-a5f0-10b9a41075f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.110482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af73d16-ffbd-465d-a5f0-10b9a41075f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.111402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af73d16-ffbd-465d-a5f0-10b9a41075f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.113125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af73d16-ffbd-465d-a5f0-10b9a41075f2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.113653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57a0d7-0659-4acd-bc25-2480ce32f544 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.120152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a2e5d-0681-4c01-921e-e8d7ddc6dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.120825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a2e5d-0681-4c01-921e-e8d7ddc6dd18 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.121216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a2e5d-0681-4c01-921e-e8d7ddc6dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.121494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a2e5d-0681-4c01-921e-e8d7ddc6dd18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.122468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a2e5d-0681-4c01-921e-e8d7ddc6dd18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.125363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a2e5d-0681-4c01-921e-e8d7ddc6dd18 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.127796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1009/1992] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:51.139629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af73d16-ffbd-465d-a5f0-10b9a41075f2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.154493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af73d16-ffbd-465d-a5f0-10b9a41075f2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.158874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 984/1993] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:51 2022] POST /identity/v3/projects => generated 401 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:51.159399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed5190-c150-4985-82ab-5f8a18f0af57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.160116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed5190-c150-4985-82ab-5f8a18f0af57 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.160860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed5190-c150-4985-82ab-5f8a18f0af57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.160860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed5190-c150-4985-82ab-5f8a18f0af57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.161379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed5190-c150-4985-82ab-5f8a18f0af57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.162891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a2e5d-0681-4c01-921e-e8d7ddc6dd18 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.163352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ed5190-c150-4985-82ab-5f8a18f0af57 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.182945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1010/1994] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:51.184333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed5190-c150-4985-82ab-5f8a18f0af57 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.196064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed5190-c150-4985-82ab-5f8a18f0af57 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.253675 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a2e5d-0681-4c01-921e-e8d7ddc6dd18 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.254359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:51.262268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742335b0-1985-4af5-b1e0-0d123a560122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.263110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742335b0-1985-4af5-b1e0-0d123a560122 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.263470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742335b0-1985-4af5-b1e0-0d123a560122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.263841 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742335b0-1985-4af5-b1e0-0d123a560122 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.265628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742335b0-1985-4af5-b1e0-0d123a560122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.267183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742335b0-1985-4af5-b1e0-0d123a560122 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.273477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f8f3a-4fbb-474b-89dc-9f0fb6203dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.274515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f8f3a-4fbb-474b-89dc-9f0fb6203dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.274846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f8f3a-4fbb-474b-89dc-9f0fb6203dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.275189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f8f3a-4fbb-474b-89dc-9f0fb6203dc3 admin admin] PATH_INFO: `/v3/projects/c99aae29971b4350be73324ad5aa6e95/users/5353926ab02f4eb09105bd0897c880e4/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.305413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 985/1995] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:51 2022] POST /identity/v3/users => generated 307 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:51.306702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742335b0-1985-4af5-b1e0-0d123a560122 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.309891 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f8f3a-4fbb-474b-89dc-9f0fb6203dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c99aae29971b4350be73324ad5aa6e95, user_id=5353926ab02f4eb09105bd0897c880e4, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.313285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f8f3a-4fbb-474b-89dc-9f0fb6203dc3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.314270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:51.319118 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742335b0-1985-4af5-b1e0-0d123a560122 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.326917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49fd50e-e9a1-49f7-85ed-f5f7cc733664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.330857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fd50e-e9a1-49f7-85ed-f5f7cc733664 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.331360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fd50e-e9a1-49f7-85ed-f5f7cc733664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.331741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49fd50e-e9a1-49f7-85ed-f5f7cc733664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.332485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fd50e-e9a1-49f7-85ed-f5f7cc733664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.334221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49fd50e-e9a1-49f7-85ed-f5f7cc733664 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.339278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1011/1996] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:51 2022] PUT /identity/v3/projects/c99aae29971b4350be73324ad5aa6e95/users/5353926ab02f4eb09105bd0897c880e4/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:51.348384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 986/1997] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:51.353652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f8f3a-4fbb-474b-89dc-9f0fb6203dc3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.356364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8a82a-1f04-4e8d-8023-c88d6688d0ab None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.356742 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8a82a-1f04-4e8d-8023-c88d6688d0ab None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.357099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e8a82a-1f04-4e8d-8023-c88d6688d0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.394281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d4e8a82a-1f04-4e8d-8023-c88d6688d0ab None None] MFA Rules not processed for user `5353926ab02f4eb09105bd0897c880e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:51.395490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d4e8a82a-1f04-4e8d-8023-c88d6688d0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:51.435463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f8f3a-4fbb-474b-89dc-9f0fb6203dc3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.442112 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f202b02-fc18-421b-b5d3-f20512b09354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.443059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f202b02-fc18-421b-b5d3-f20512b09354 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.443515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f202b02-fc18-421b-b5d3-f20512b09354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.443945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f202b02-fc18-421b-b5d3-f20512b09354 admin admin] PATH_INFO: `/v3/projects/36b475fa67c54ccaa0c2dd3cf5410531/users/96a1d292835f44a9a160e1c59d1f513c/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.472173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f202b02-fc18-421b-b5d3-f20512b09354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b475fa67c54ccaa0c2dd3cf5410531, user_id=96a1d292835f44a9a160e1c59d1f513c, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.475047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f202b02-fc18-421b-b5d3-f20512b09354 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.491203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1012/1998] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:51 2022] PUT /identity/v3/projects/36b475fa67c54ccaa0c2dd3cf5410531/users/96a1d292835f44a9a160e1c59d1f513c/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:43:51.495211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f202b02-fc18-421b-b5d3-f20512b09354 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.532290 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 987/1999] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:51.541231 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8a82a-1f04-4e8d-8023-c88d6688d0ab None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.621874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f202b02-fc18-421b-b5d3-f20512b09354 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.630257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cc9ea-79c5-43f8-96ed-c5188f303c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.633335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e8a82a-1f04-4e8d-8023-c88d6688d0ab None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.635007 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc9ea-79c5-43f8-96ed-c5188f303c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.635968 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc9ea-79c5-43f8-96ed-c5188f303c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.636580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cc9ea-79c5-43f8-96ed-c5188f303c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.639370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cc9ea-79c5-43f8-96ed-c5188f303c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.645268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cc9ea-79c5-43f8-96ed-c5188f303c5c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.662530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1013/2000] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:51.668725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cc9ea-79c5-43f8-96ed-c5188f303c5c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.689617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cc9ea-79c5-43f8-96ed-c5188f303c5c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.699163 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0649620-4e3c-4553-bf67-fce47e030a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.703831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0649620-4e3c-4553-bf67-fce47e030a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.703831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0649620-4e3c-4553-bf67-fce47e030a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.703831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0649620-4e3c-4553-bf67-fce47e030a8a admin admin] PATH_INFO: `/v3/projects/36b475fa67c54ccaa0c2dd3cf5410531/users/96a1d292835f44a9a160e1c59d1f513c/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.710438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0649620-4e3c-4553-bf67-fce47e030a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=36b475fa67c54ccaa0c2dd3cf5410531, user_id=96a1d292835f44a9a160e1c59d1f513c, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.713578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabf8e8-fc57-4f19-a9e8-2eaa42516bb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.714425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabf8e8-fc57-4f19-a9e8-2eaa42516bb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.714855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabf8e8-fc57-4f19-a9e8-2eaa42516bb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.715136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dabf8e8-fc57-4f19-a9e8-2eaa42516bb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.715296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0649620-4e3c-4553-bf67-fce47e030a8a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.728099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1014/2001] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:51 2022] PUT /identity/v3/projects/36b475fa67c54ccaa0c2dd3cf5410531/users/96a1d292835f44a9a160e1c59d1f513c/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:51.739048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c357c-dad5-4fc0-abfb-7fc75a689657 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.739337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c357c-dad5-4fc0-abfb-7fc75a689657 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.739660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91c357c-dad5-4fc0-abfb-7fc75a689657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.772366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a91c357c-dad5-4fc0-abfb-7fc75a689657 None None] MFA Rules not processed for user `96a1d292835f44a9a160e1c59d1f513c`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:51.773519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a91c357c-dad5-4fc0-abfb-7fc75a689657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:51.798684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:51.801587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:51.807173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabf8e8-fc57-4f19-a9e8-2eaa42516bb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.809932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dabf8e8-fc57-4f19-a9e8-2eaa42516bb9 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.822534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 988/2002] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:51 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:43:51.866599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1015/2003] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:51.885800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabf8e8-fc57-4f19-a9e8-2eaa42516bb9 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:51.887307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1dabf8e8-fc57-4f19-a9e8-2eaa42516bb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:51.899776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dabf8e8-fc57-4f19-a9e8-2eaa42516bb9 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:51.961628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a2b01-d6fc-4302-80bd-0e18a9da4f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:51.962415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a2b01-d6fc-4302-80bd-0e18a9da4f55 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:51.962700 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a2b01-d6fc-4302-80bd-0e18a9da4f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:51.962978 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a2b01-d6fc-4302-80bd-0e18a9da4f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:51.973477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a2b01-d6fc-4302-80bd-0e18a9da4f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:51.974972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a2b01-d6fc-4302-80bd-0e18a9da4f55 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:51.986614 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 989/2004] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:51 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:52.151628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c357c-dad5-4fc0-abfb-7fc75a689657 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:52.166512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91c357c-dad5-4fc0-abfb-7fc75a689657 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:52.174203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad249450-08b8-4c77-b1e9-15f49265dbc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:52.175621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249450-08b8-4c77-b1e9-15f49265dbc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:52.176481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249450-08b8-4c77-b1e9-15f49265dbc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:52.176907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad249450-08b8-4c77-b1e9-15f49265dbc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:52.309292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad249450-08b8-4c77-b1e9-15f49265dbc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:52.310863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad249450-08b8-4c77-b1e9-15f49265dbc0 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:52.322099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1016/2005] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:52.641182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c328-a43d-4ac8-8625-0a5af8adfb26 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:52.641644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c328-a43d-4ac8-8625-0a5af8adfb26 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:52.641875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c328-a43d-4ac8-8625-0a5af8adfb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:52.666531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-63f8c328-a43d-4ac8-8625-0a5af8adfb26 None None] MFA Rules not processed for user `83722d9ffa5c41d292c56a66ebbd8d17`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:52.667974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-63f8c328-a43d-4ac8-8625-0a5af8adfb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:52.748961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 990/2006] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:57.038114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad249450-08b8-4c77-b1e9-15f49265dbc0 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:57.181907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad249450-08b8-4c77-b1e9-15f49265dbc0 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:57.189603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:57.190540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.190819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.191092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] PATH_INFO: `/v3/users/0c91463aa4ab4881bf76bf57c79f507d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.192541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c91463aa4ab4881bf76bf57c79f507d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:57.195105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:57.299839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c91463aa4ab4881bf76bf57c79f507d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:57.311427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c91463aa4ab4881bf76bf57c79f507d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:57.312888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c91463aa4ab4881bf76bf57c79f507d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:57.328072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:57.342269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c91463aa4ab4881bf76bf57c79f507d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:57.353975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c91463aa4ab4881bf76bf57c79f507d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:57.365691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1017/2007] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:57 2022] DELETE /identity/v3/users/0c91463aa4ab4881bf76bf57c79f507d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:57.370291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc2ca-b06c-422e-b493-c904ef2e7e0d None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.371222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc2ca-b06c-422e-b493-c904ef2e7e0d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.371508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc2ca-b06c-422e-b493-c904ef2e7e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.398468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e8abc2ca-b06c-422e-b493-c904ef2e7e0d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:57.400430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e8abc2ca-b06c-422e-b493-c904ef2e7e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:57.505711 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 991/2008] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:57.513474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:57.515795 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:57.669523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c8ef1c-801c-49ab-bb54-f047b0fbd87c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:57.676151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cee3a-69f0-44c1-967b-e53950e71a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:57.682897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cee3a-69f0-44c1-967b-e53950e71a22 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:57.683817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cee3a-69f0-44c1-967b-e53950e71a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:57.685321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cee3a-69f0-44c1-967b-e53950e71a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:57.716580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cee3a-69f0-44c1-967b-e53950e71a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:57.721652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cee3a-69f0-44c1-967b-e53950e71a22 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:57.759164 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1018/2009] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:43:58.363945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abc2ca-b06c-422e-b493-c904ef2e7e0d None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:58.366054 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e8abc2ca-b06c-422e-b493-c904ef2e7e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:58.379636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abc2ca-b06c-422e-b493-c904ef2e7e0d None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:58.396651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:58.398412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:58.398895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:58.399385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] PATH_INFO: `/v3/projects/13b7d669106a429dbf4c0265dfae1146` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:58.401533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b7d669106a429dbf4c0265dfae1146)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:58.404325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:58.501413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:58.517922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b7d669106a429dbf4c0265dfae1146', 'request_id': 'req-aae04681-c9ab-4c92-ab67-b83ba79c0b91'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:58.530163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b7d669106a429dbf4c0265dfae1146', 'request_id': 'req-aae04681-c9ab-4c92-ab67-b83ba79c0b91'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:58.543463 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b7d669106a429dbf4c0265dfae1146', 'request_id': 'req-aae04681-c9ab-4c92-ab67-b83ba79c0b91'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:58.565132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] The token cache is being invalidate because project 13b7d669106a429dbf4c0265dfae1146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:58.565450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:58.566185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:58.568890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 992/2010] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:58 2022] DELETE /identity/v3/projects/13b7d669106a429dbf4c0265dfae1146 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:58.572847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cee3a-69f0-44c1-967b-e53950e71a22 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:58.586526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cee3a-69f0-44c1-967b-e53950e71a22 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:58.675916 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:58.676821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:58.677102 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:58.677380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] PATH_INFO: `/v3/users/96a1d292835f44a9a160e1c59d1f513c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:58.678662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96a1d292835f44a9a160e1c59d1f513c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:58.680933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:58.777759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96a1d292835f44a9a160e1c59d1f513c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:58.788005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96a1d292835f44a9a160e1c59d1f513c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:58.789031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96a1d292835f44a9a160e1c59d1f513c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:58.808759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96a1d292835f44a9a160e1c59d1f513c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:58.818983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-16a67f9f-3581-4347-906a-a08bc73137f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96a1d292835f44a9a160e1c59d1f513c'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:58.824109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:58.835792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1019/2011] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:43:58 2022] DELETE /identity/v3/users/96a1d292835f44a9a160e1c59d1f513c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:59.170025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:59.175190 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:59.195284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae04681-c9ab-4c92-ab67-b83ba79c0b91 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:59.283173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:59.283968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.284251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.284522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] PATH_INFO: `/v3/projects/36b475fa67c54ccaa0c2dd3cf5410531` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.285733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36b475fa67c54ccaa0c2dd3cf5410531)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:59.287680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:59.341866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36b475fa67c54ccaa0c2dd3cf5410531', 'request_id': 'req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:59.351411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36b475fa67c54ccaa0c2dd3cf5410531', 'request_id': 'req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:59.366063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36b475fa67c54ccaa0c2dd3cf5410531', 'request_id': 'req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:59.379292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] The token cache is being invalidate because project 36b475fa67c54ccaa0c2dd3cf5410531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:43:59.379703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:59.380553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0e9017d5-aed4-47b5-8a86-9cd58ae132d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:43:59.382430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 993/2012] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:43:59 2022] DELETE /identity/v3/projects/36b475fa67c54ccaa0c2dd3cf5410531 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:59.387928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab457c19-8010-4158-b52c-037d739bccfe None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.388257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab457c19-8010-4158-b52c-037d739bccfe None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.388757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab457c19-8010-4158-b52c-037d739bccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.410615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ab457c19-8010-4158-b52c-037d739bccfe None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:59.412077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ab457c19-8010-4158-b52c-037d739bccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:59.493333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1020/2013] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:43:59.501957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1232a-844a-48b6-ad79-85bfd58c2ac8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.502596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1232a-844a-48b6-ad79-85bfd58c2ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.502955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f1232a-844a-48b6-ad79-85bfd58c2ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.523951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-67f1232a-844a-48b6-ad79-85bfd58c2ac8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:43:59.525276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-67f1232a-844a-48b6-ad79-85bfd58c2ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:43:59.533885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 994/2014] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:43:59.538000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab457c19-8010-4158-b52c-037d739bccfe None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:59.548297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab457c19-8010-4158-b52c-037d739bccfe None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:59.553036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fb6c5-8dcd-40b6-abab-4a17370bc8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:59.553779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb6c5-8dcd-40b6-abab-4a17370bc8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.553975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb6c5-8dcd-40b6-abab-4a17370bc8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.554272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fb6c5-8dcd-40b6-abab-4a17370bc8b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.555007 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fb6c5-8dcd-40b6-abab-4a17370bc8b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:43:59.555313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fb6c5-8dcd-40b6-abab-4a17370bc8b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:59.557106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fb6c5-8dcd-40b6-abab-4a17370bc8b3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:59.572588 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1021/2015] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:43:59.577221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1232a-844a-48b6-ad79-85bfd58c2ac8 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:59.587809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f1232a-844a-48b6-ad79-85bfd58c2ac8 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:59.593050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a356b25-683e-4d82-832d-4a5ef116070b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:59.593727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356b25-683e-4d82-832d-4a5ef116070b admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.594010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356b25-683e-4d82-832d-4a5ef116070b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.594311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a356b25-683e-4d82-832d-4a5ef116070b admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.595118 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a356b25-683e-4d82-832d-4a5ef116070b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:59.597581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a356b25-683e-4d82-832d-4a5ef116070b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:59.630419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 995/2016] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:43:59 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:59.633131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fb6c5-8dcd-40b6-abab-4a17370bc8b3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:59.649659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fb6c5-8dcd-40b6-abab-4a17370bc8b3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:59.719981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be86d3-d547-460a-a82f-3365b5ebb17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:59.720664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be86d3-d547-460a-a82f-3365b5ebb17e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.721019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be86d3-d547-460a-a82f-3365b5ebb17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.721481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be86d3-d547-460a-a82f-3365b5ebb17e admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.722280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be86d3-d547-460a-a82f-3365b5ebb17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:59.724304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be86d3-d547-460a-a82f-3365b5ebb17e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:59.752996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1022/2017] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:43:59 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:43:59.760267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a356b25-683e-4d82-832d-4a5ef116070b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:59.773488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a356b25-683e-4d82-832d-4a5ef116070b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:59.782770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0f95d-ba5b-4451-84a2-afc9851aca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:59.783430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0f95d-ba5b-4451-84a2-afc9851aca32 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.783718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0f95d-ba5b-4451-84a2-afc9851aca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.784087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0f95d-ba5b-4451-84a2-afc9851aca32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.785274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0f95d-ba5b-4451-84a2-afc9851aca32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:59.786503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0f95d-ba5b-4451-84a2-afc9851aca32 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:59.799874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 996/2018] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:59.807157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be86d3-d547-460a-a82f-3365b5ebb17e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:59.821472 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be86d3-d547-460a-a82f-3365b5ebb17e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:59.827642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef07f99-330f-46f7-963a-52b1f2239d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:59.828344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef07f99-330f-46f7-963a-52b1f2239d3b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.828634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef07f99-330f-46f7-963a-52b1f2239d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.828914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef07f99-330f-46f7-963a-52b1f2239d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.829658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef07f99-330f-46f7-963a-52b1f2239d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:59.831333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef07f99-330f-46f7-963a-52b1f2239d3b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:59.853447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1023/2019] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:43:59.854987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0f95d-ba5b-4451-84a2-afc9851aca32 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:43:59.868431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0f95d-ba5b-4451-84a2-afc9851aca32 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:43:59.875299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dc0c8-6387-49df-9562-862b8920a785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:43:59.876272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dc0c8-6387-49df-9562-862b8920a785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.876562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dc0c8-6387-49df-9562-862b8920a785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.876844 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dc0c8-6387-49df-9562-862b8920a785 admin admin] PATH_INFO: `/v3/projects/24fbf2a97f454dfd85e3899fc2d3948e/users/c9a0353091cf4a079e63cf5d62ec5658/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:43:59.892799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:43:59.904506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dc0c8-6387-49df-9562-862b8920a785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24fbf2a97f454dfd85e3899fc2d3948e, user_id=c9a0353091cf4a079e63cf5d62ec5658, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:43:59.907758 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dc0c8-6387-49df-9562-862b8920a785 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:43:59.938135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 997/2020] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:43:59 2022] PUT /identity/v3/projects/24fbf2a97f454dfd85e3899fc2d3948e/users/c9a0353091cf4a079e63cf5d62ec5658/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:43:59.948349 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb762ac1-0e66-4808-b8cf-c8b6c8583cbf None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:43:59.948951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb762ac1-0e66-4808-b8cf-c8b6c8583cbf None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:43:59.949243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb762ac1-0e66-4808-b8cf-c8b6c8583cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.004508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-eb762ac1-0e66-4808-b8cf-c8b6c8583cbf None None] MFA Rules not processed for user `c9a0353091cf4a079e63cf5d62ec5658`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:00.005918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-eb762ac1-0e66-4808-b8cf-c8b6c8583cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:00.079560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:00.092652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1024/2021] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:43:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:00.098284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dc0c8-6387-49df-9562-862b8920a785 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:00.163678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dc0c8-6387-49df-9562-862b8920a785 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:00.168608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316c76b-d3a1-4bfa-a15c-5a863e4c4362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:00.169300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316c76b-d3a1-4bfa-a15c-5a863e4c4362 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.169582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316c76b-d3a1-4bfa-a15c-5a863e4c4362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.169880 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316c76b-d3a1-4bfa-a15c-5a863e4c4362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.170632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316c76b-d3a1-4bfa-a15c-5a863e4c4362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:00.173213 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316c76b-d3a1-4bfa-a15c-5a863e4c4362 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:00.204985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 998/2022] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:00 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:00.208987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb762ac1-0e66-4808-b8cf-c8b6c8583cbf None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:00.220088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb762ac1-0e66-4808-b8cf-c8b6c8583cbf None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:00.279358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53363690-520a-4285-bcf9-eb8cefac0239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:00.280076 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53363690-520a-4285-bcf9-eb8cefac0239 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.280888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53363690-520a-4285-bcf9-eb8cefac0239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.281168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53363690-520a-4285-bcf9-eb8cefac0239 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.282041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53363690-520a-4285-bcf9-eb8cefac0239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:00.284058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53363690-520a-4285-bcf9-eb8cefac0239 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:00.308093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1025/2023] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:00 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:00.312662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316c76b-d3a1-4bfa-a15c-5a863e4c4362 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:00.324235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316c76b-d3a1-4bfa-a15c-5a863e4c4362 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:00.331998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5702a54-d8b7-4eb9-8ee2-84f3e66155e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:00.332699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702a54-d8b7-4eb9-8ee2-84f3e66155e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.332979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702a54-d8b7-4eb9-8ee2-84f3e66155e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.333255 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5702a54-d8b7-4eb9-8ee2-84f3e66155e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.334012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5702a54-d8b7-4eb9-8ee2-84f3e66155e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:00.335770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5702a54-d8b7-4eb9-8ee2-84f3e66155e7 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:00.351266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 999/2024] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:00.355633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53363690-520a-4285-bcf9-eb8cefac0239 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:00.370907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53363690-520a-4285-bcf9-eb8cefac0239 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:00.376500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba2b0b-3c69-4e38-b462-9ed8c54e14df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:00.377595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba2b0b-3c69-4e38-b462-9ed8c54e14df admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.377885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba2b0b-3c69-4e38-b462-9ed8c54e14df admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.378186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfba2b0b-3c69-4e38-b462-9ed8c54e14df admin admin] PATH_INFO: `/v3/projects/864b5146dba044b5b2f0b2a0f36289e9/users/7b2bd0bab6fb442c86d453f3bf29cb01/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.397127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba2b0b-3c69-4e38-b462-9ed8c54e14df admin admin] RBAC: Authorizing `identity:create_grant(project_id=864b5146dba044b5b2f0b2a0f36289e9, user_id=7b2bd0bab6fb442c86d453f3bf29cb01, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:00.400060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfba2b0b-3c69-4e38-b462-9ed8c54e14df admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:00.414470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1026/2025] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:00 2022] PUT /identity/v3/projects/864b5146dba044b5b2f0b2a0f36289e9/users/7b2bd0bab6fb442c86d453f3bf29cb01/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:00.418925 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5702a54-d8b7-4eb9-8ee2-84f3e66155e7 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:00.436786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5702a54-d8b7-4eb9-8ee2-84f3e66155e7 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:00.508663 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67fd9c-cc0b-410d-ac83-9a510029af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:00.509353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fd9c-cc0b-410d-ac83-9a510029af31 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.509639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fd9c-cc0b-410d-ac83-9a510029af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.509918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67fd9c-cc0b-410d-ac83-9a510029af31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.510825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67fd9c-cc0b-410d-ac83-9a510029af31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:00.512458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67fd9c-cc0b-410d-ac83-9a510029af31 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:00.524209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1000/2026] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:00.528495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba2b0b-3c69-4e38-b462-9ed8c54e14df admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:00.541622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfba2b0b-3c69-4e38-b462-9ed8c54e14df admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:00.547738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ac39-1598-42c6-96af-ab4f1e904b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:00.548659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ac39-1598-42c6-96af-ab4f1e904b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.548945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ac39-1598-42c6-96af-ab4f1e904b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.549223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ac39-1598-42c6-96af-ab4f1e904b3e admin admin] PATH_INFO: `/v3/projects/864b5146dba044b5b2f0b2a0f36289e9/users/7b2bd0bab6fb442c86d453f3bf29cb01/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.551362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ac39-1598-42c6-96af-ab4f1e904b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=864b5146dba044b5b2f0b2a0f36289e9, user_id=7b2bd0bab6fb442c86d453f3bf29cb01, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:00.554295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8603ac39-1598-42c6-96af-ab4f1e904b3e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:00.567878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1027/2027] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:00 2022] PUT /identity/v3/projects/864b5146dba044b5b2f0b2a0f36289e9/users/7b2bd0bab6fb442c86d453f3bf29cb01/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:00.577959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2b370-53a9-433e-9aaf-ed2f3332b195 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.578460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2b370-53a9-433e-9aaf-ed2f3332b195 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.578763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d2b370-53a9-433e-9aaf-ed2f3332b195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.608920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-60d2b370-53a9-433e-9aaf-ed2f3332b195 None None] MFA Rules not processed for user `7b2bd0bab6fb442c86d453f3bf29cb01`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:00.610275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-60d2b370-53a9-433e-9aaf-ed2f3332b195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:00.663661 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:00.686448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1001/2028] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:00 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:00.698105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ac39-1598-42c6-96af-ab4f1e904b3e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:00.700562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8603ac39-1598-42c6-96af-ab4f1e904b3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:00.770660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ac39-1598-42c6-96af-ab4f1e904b3e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:00.774528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd807a-47d8-4dd9-aed8-86d6ce15bcea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:00.775210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd807a-47d8-4dd9-aed8-86d6ce15bcea service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.775492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd807a-47d8-4dd9-aed8-86d6ce15bcea service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.775763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd807a-47d8-4dd9-aed8-86d6ce15bcea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.788302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd807a-47d8-4dd9-aed8-86d6ce15bcea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:00.789775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebd807a-47d8-4dd9-aed8-86d6ce15bcea service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:00.800848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1028/2029] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:00.913501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2b370-53a9-433e-9aaf-ed2f3332b195 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:00.930172 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d2b370-53a9-433e-9aaf-ed2f3332b195 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:00.934195 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d814d58-6adc-414f-adcb-3ad1bc716677 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:00.934853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d814d58-6adc-414f-adcb-3ad1bc716677 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:00.935163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d814d58-6adc-414f-adcb-3ad1bc716677 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:00.935436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d814d58-6adc-414f-adcb-3ad1bc716677 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:00.998045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d814d58-6adc-414f-adcb-3ad1bc716677 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:01.000091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d814d58-6adc-414f-adcb-3ad1bc716677 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:01.011364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1002/2030] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:02.182287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd807a-47d8-4dd9-aed8-86d6ce15bcea service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.183691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bebd807a-47d8-4dd9-aed8-86d6ce15bcea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:02.233449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:02.249466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd807a-47d8-4dd9-aed8-86d6ce15bcea service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.254011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.254905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.255189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.255467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] PATH_INFO: `/v3/users/5353926ab02f4eb09105bd0897c880e4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.256648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5353926ab02f4eb09105bd0897c880e4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.258886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.307489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5353926ab02f4eb09105bd0897c880e4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:02.314025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5353926ab02f4eb09105bd0897c880e4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:02.314674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5353926ab02f4eb09105bd0897c880e4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:02.326485 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5353926ab02f4eb09105bd0897c880e4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:02.333875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5353926ab02f4eb09105bd0897c880e4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:02.345219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1029/2031] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:02 2022] DELETE /identity/v3/users/5353926ab02f4eb09105bd0897c880e4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:02.349811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d1a0d-062e-4a49-8748-683987f3f862 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.350319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d1a0d-062e-4a49-8748-683987f3f862 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.350412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d1a0d-062e-4a49-8748-683987f3f862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.367638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-ea4d1a0d-062e-4a49-8748-683987f3f862 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:02.368954 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ea4d1a0d-062e-4a49-8748-683987f3f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:02.434071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1003/2032] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:02.442371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.443930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:02.519507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb211d-b64d-4777-b70d-7d50e881d64d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.524373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee4677-ce0c-43ae-a825-17b11d773443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.525027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4677-ce0c-43ae-a825-17b11d773443 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.525308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4677-ce0c-43ae-a825-17b11d773443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.525581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee4677-ce0c-43ae-a825-17b11d773443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.536148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee4677-ce0c-43ae-a825-17b11d773443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.538188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee4677-ce0c-43ae-a825-17b11d773443 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.552307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1030/2033] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:02.895523 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d1a0d-062e-4a49-8748-683987f3f862 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:02.897167 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ea4d1a0d-062e-4a49-8748-683987f3f862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:02.910769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d1a0d-062e-4a49-8748-683987f3f862 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:02.915594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:02.916623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:02.916933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:02.917447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] PATH_INFO: `/v3/projects/c99aae29971b4350be73324ad5aa6e95` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:02.918886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c99aae29971b4350be73324ad5aa6e95)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:02.921595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:02.998441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c99aae29971b4350be73324ad5aa6e95', 'request_id': 'req-2adc6f66-93d3-48e7-a786-0da22a241a0f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:03.009315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c99aae29971b4350be73324ad5aa6e95', 'request_id': 'req-2adc6f66-93d3-48e7-a786-0da22a241a0f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:03.016950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c99aae29971b4350be73324ad5aa6e95', 'request_id': 'req-2adc6f66-93d3-48e7-a786-0da22a241a0f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:03.028774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] The token cache is being invalidate because project c99aae29971b4350be73324ad5aa6e95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:03.029004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:03.029749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2adc6f66-93d3-48e7-a786-0da22a241a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:03.031387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1004/2034] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:02 2022] DELETE /identity/v3/projects/c99aae29971b4350be73324ad5aa6e95 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:03.039688 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab348c-7e85-4562-a7be-c04f50cbff68 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.039976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab348c-7e85-4562-a7be-c04f50cbff68 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.040614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab348c-7e85-4562-a7be-c04f50cbff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.058738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c3ab348c-7e85-4562-a7be-c04f50cbff68 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:03.059939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c3ab348c-7e85-4562-a7be-c04f50cbff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:03.121961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1031/2035] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:03.132221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846a020-813a-4db7-813f-f691f9b0804c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.132506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846a020-813a-4db7-813f-f691f9b0804c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.132781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846a020-813a-4db7-813f-f691f9b0804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.151260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-4846a020-813a-4db7-813f-f691f9b0804c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:03.152549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4846a020-813a-4db7-813f-f691f9b0804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:03.161748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1005/2036] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:03.166182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab348c-7e85-4562-a7be-c04f50cbff68 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.176703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab348c-7e85-4562-a7be-c04f50cbff68 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.181347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133633f-24c1-4635-8040-476ef6d614a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.181987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133633f-24c1-4635-8040-476ef6d614a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.182295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133633f-24c1-4635-8040-476ef6d614a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.182566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f133633f-24c1-4635-8040-476ef6d614a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.183284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133633f-24c1-4635-8040-476ef6d614a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:03.183586 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133633f-24c1-4635-8040-476ef6d614a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.185190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f133633f-24c1-4635-8040-476ef6d614a5 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.191840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:03.198886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1032/2037] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:03.202177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846a020-813a-4db7-813f-f691f9b0804c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.206769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:03.213248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846a020-813a-4db7-813f-f691f9b0804c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.219326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98c629-bd7b-4318-9dc0-d0e6ef49c70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.219979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c629-bd7b-4318-9dc0-d0e6ef49c70f admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.221555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c629-bd7b-4318-9dc0-d0e6ef49c70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.221859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab98c629-bd7b-4318-9dc0-d0e6ef49c70f admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.222611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98c629-bd7b-4318-9dc0-d0e6ef49c70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.224527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab98c629-bd7b-4318-9dc0-d0e6ef49c70f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.256592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1006/2038] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:03.260921 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133633f-24c1-4635-8040-476ef6d614a5 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.271201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f133633f-24c1-4635-8040-476ef6d614a5 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.329286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92149251-f260-4858-9b86-2a4507362f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.329869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149251-f260-4858-9b86-2a4507362f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.330181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149251-f260-4858-9b86-2a4507362f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.330457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149251-f260-4858-9b86-2a4507362f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.331135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92149251-f260-4858-9b86-2a4507362f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.333065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92149251-f260-4858-9b86-2a4507362f22 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.354257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1033/2039] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:03.373154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98c629-bd7b-4318-9dc0-d0e6ef49c70f admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.375518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab98c629-bd7b-4318-9dc0-d0e6ef49c70f admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.380323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43df62-4a2d-4c90-b9b0-1b8652729ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.381029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43df62-4a2d-4c90-b9b0-1b8652729ece admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.381314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43df62-4a2d-4c90-b9b0-1b8652729ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.381590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43df62-4a2d-4c90-b9b0-1b8652729ece admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.383094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43df62-4a2d-4c90-b9b0-1b8652729ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.386151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43df62-4a2d-4c90-b9b0-1b8652729ece admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.403152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1007/2040] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:03.408599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92149251-f260-4858-9b86-2a4507362f22 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.419417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92149251-f260-4858-9b86-2a4507362f22 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.426789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23e116f-8b2a-446e-9567-77b23aeaadb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.427466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e116f-8b2a-446e-9567-77b23aeaadb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.427756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e116f-8b2a-446e-9567-77b23aeaadb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.428036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23e116f-8b2a-446e-9567-77b23aeaadb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.428826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e116f-8b2a-446e-9567-77b23aeaadb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.430501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23e116f-8b2a-446e-9567-77b23aeaadb2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.442481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1034/2041] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:03.447058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43df62-4a2d-4c90-b9b0-1b8652729ece admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.457906 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43df62-4a2d-4c90-b9b0-1b8652729ece admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.462624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047c71b-2ec8-40f1-b4d0-7b07aaa108bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.463509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047c71b-2ec8-40f1-b4d0-7b07aaa108bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.464091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047c71b-2ec8-40f1-b4d0-7b07aaa108bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.464401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047c71b-2ec8-40f1-b4d0-7b07aaa108bb admin admin] PATH_INFO: `/v3/projects/cfc17cc60c274865ac5ba02fae92fa4c/users/98c3c554b28348e2988b118433527df9/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.482209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047c71b-2ec8-40f1-b4d0-7b07aaa108bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc17cc60c274865ac5ba02fae92fa4c, user_id=98c3c554b28348e2988b118433527df9, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.486021 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047c71b-2ec8-40f1-b4d0-7b07aaa108bb admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.501901 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1008/2042] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:03 2022] PUT /identity/v3/projects/cfc17cc60c274865ac5ba02fae92fa4c/users/98c3c554b28348e2988b118433527df9/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:03.512486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6dd68-0142-4577-9429-ae1c8ae9e6cc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.512777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6dd68-0142-4577-9429-ae1c8ae9e6cc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.513060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6dd68-0142-4577-9429-ae1c8ae9e6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.541955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-73f6dd68-0142-4577-9429-ae1c8ae9e6cc None None] MFA Rules not processed for user `98c3c554b28348e2988b118433527df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:03.543225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-73f6dd68-0142-4577-9429-ae1c8ae9e6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:03.612834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1035/2043] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:03.617465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047c71b-2ec8-40f1-b4d0-7b07aaa108bb admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.674707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6dd68-0142-4577-9429-ae1c8ae9e6cc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.677516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-73f6dd68-0142-4577-9429-ae1c8ae9e6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:03.727772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047c71b-2ec8-40f1-b4d0-7b07aaa108bb admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.735407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7e753-179d-4361-abb5-bdcb069b246c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.736277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7e753-179d-4361-abb5-bdcb069b246c admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.736762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7e753-179d-4361-abb5-bdcb069b246c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.737287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7e753-179d-4361-abb5-bdcb069b246c admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.738167 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7e753-179d-4361-abb5-bdcb069b246c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.741769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d7e753-179d-4361-abb5-bdcb069b246c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.783963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1009/2044] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:03.788860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7e753-179d-4361-abb5-bdcb069b246c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.820081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6dd68-0142-4577-9429-ae1c8ae9e6cc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.838075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:03.915624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7e753-179d-4361-abb5-bdcb069b246c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.920985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc49a6-fa17-4644-b502-2a47813ba4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.921870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc49a6-fa17-4644-b502-2a47813ba4b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.922181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc49a6-fa17-4644-b502-2a47813ba4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.922524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc49a6-fa17-4644-b502-2a47813ba4b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.923239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc49a6-fa17-4644-b502-2a47813ba4b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.925780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc49a6-fa17-4644-b502-2a47813ba4b4 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.938629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.939587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.939875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.940202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] PATH_INFO: `/v3/users/c9a0353091cf4a079e63cf5d62ec5658` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.941885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a0353091cf4a079e63cf5d62ec5658)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.943949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.953957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1010/2045] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:03 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:03.957734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc49a6-fa17-4644-b502-2a47813ba4b4 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.968405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc49a6-fa17-4644-b502-2a47813ba4b4 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:03.974691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3face2e-9fd0-4283-bee7-19d86838e588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:03.975375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3face2e-9fd0-4283-bee7-19d86838e588 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:03.975649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3face2e-9fd0-4283-bee7-19d86838e588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:03.975926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3face2e-9fd0-4283-bee7-19d86838e588 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:03.976647 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3face2e-9fd0-4283-bee7-19d86838e588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:03.978685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3face2e-9fd0-4283-bee7-19d86838e588 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:03.992727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1011/2046] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:03.993801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3face2e-9fd0-4283-bee7-19d86838e588 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:03.996232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a0353091cf4a079e63cf5d62ec5658'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:04.004765 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3face2e-9fd0-4283-bee7-19d86838e588 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.005327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a0353091cf4a079e63cf5d62ec5658'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:04.006209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a0353091cf4a079e63cf5d62ec5658'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:04.010561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9c131-3d2b-4eeb-bea9-0f0c3baeff8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.011237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9c131-3d2b-4eeb-bea9-0f0c3baeff8a admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.011526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9c131-3d2b-4eeb-bea9-0f0c3baeff8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.012041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9c131-3d2b-4eeb-bea9-0f0c3baeff8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.012624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9c131-3d2b-4eeb-bea9-0f0c3baeff8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.014263 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9c131-3d2b-4eeb-bea9-0f0c3baeff8a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.017317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:04.019880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a0353091cf4a079e63cf5d62ec5658'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:04.027074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e923e6e4-2804-47ca-890d-4d8153c114b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a0353091cf4a079e63cf5d62ec5658'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:04.030557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1012/2047] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:04.031642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9c131-3d2b-4eeb-bea9-0f0c3baeff8a admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.033401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-2fa9c131-3d2b-4eeb-bea9-0f0c3baeff8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:04.033860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1036/2048] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:03 2022] DELETE /identity/v3/users/c9a0353091cf4a079e63cf5d62ec5658 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:04.038450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26edeb-a43b-4e36-955c-97ec5a123185 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.038742 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26edeb-a43b-4e36-955c-97ec5a123185 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.039017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26edeb-a43b-4e36-955c-97ec5a123185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.046277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9c131-3d2b-4eeb-bea9-0f0c3baeff8a admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.057319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1f26edeb-a43b-4e36-955c-97ec5a123185 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:04.058970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1f26edeb-a43b-4e36-955c-97ec5a123185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:04.114480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059f02f-0799-4de6-ae44-26a076baf7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.115336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f02f-0799-4de6-ae44-26a076baf7c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.115624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f02f-0799-4de6-ae44-26a076baf7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.115903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059f02f-0799-4de6-ae44-26a076baf7c2 admin admin] PATH_INFO: `/v3/projects/6bbd0416849f4cb882f1e3eb8428faa5/users/5ba6771fb338470b9f8b03509a898f4a/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.135985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059f02f-0799-4de6-ae44-26a076baf7c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bbd0416849f4cb882f1e3eb8428faa5, user_id=5ba6771fb338470b9f8b03509a898f4a, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.138953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059f02f-0799-4de6-ae44-26a076baf7c2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.144229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1037/2049] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:04.155150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26edeb-a43b-4e36-955c-97ec5a123185 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.156597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1f26edeb-a43b-4e36-955c-97ec5a123185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:04.157268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1013/2050] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:04 2022] PUT /identity/v3/projects/6bbd0416849f4cb882f1e3eb8428faa5/users/5ba6771fb338470b9f8b03509a898f4a/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:04.169336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8475dc1-1e1e-4be3-8842-7ba3755a3a1b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.170032 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8475dc1-1e1e-4be3-8842-7ba3755a3a1b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.170537 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8475dc1-1e1e-4be3-8842-7ba3755a3a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.205743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:04.218809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-f8475dc1-1e1e-4be3-8842-7ba3755a3a1b None None] MFA Rules not processed for user `5ba6771fb338470b9f8b03509a898f4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:04.220050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f8475dc1-1e1e-4be3-8842-7ba3755a3a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:04.234846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26edeb-a43b-4e36-955c-97ec5a123185 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.299309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1014/2051] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:04.300131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8475dc1-1e1e-4be3-8842-7ba3755a3a1b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.308469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af7dd-ba50-4a00-bbb8-77ff0b69e623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.309468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af7dd-ba50-4a00-bbb8-77ff0b69e623 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.309956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af7dd-ba50-4a00-bbb8-77ff0b69e623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.310881 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3af7dd-ba50-4a00-bbb8-77ff0b69e623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.378799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8475dc1-1e1e-4be3-8842-7ba3755a3a1b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.384023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c913-879d-4406-a4a7-83e34e19213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.384798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c913-879d-4406-a4a7-83e34e19213b admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.385154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c913-879d-4406-a4a7-83e34e19213b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.385501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0c913-879d-4406-a4a7-83e34e19213b admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.386305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0c913-879d-4406-a4a7-83e34e19213b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.386985 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3af7dd-ba50-4a00-bbb8-77ff0b69e623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.388396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0c913-879d-4406-a4a7-83e34e19213b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.388499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3af7dd-ba50-4a00-bbb8-77ff0b69e623 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.398880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1038/2052] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:04.407153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:04.428825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1015/2053] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:04 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:04.433553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af7dd-ba50-4a00-bbb8-77ff0b69e623 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.448605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3af7dd-ba50-4a00-bbb8-77ff0b69e623 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.524793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4424a0-83e0-46b3-8ffd-34af008f1e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.525851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4424a0-83e0-46b3-8ffd-34af008f1e38 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.526229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4424a0-83e0-46b3-8ffd-34af008f1e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.526587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4424a0-83e0-46b3-8ffd-34af008f1e38 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.527692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4424a0-83e0-46b3-8ffd-34af008f1e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.530622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4424a0-83e0-46b3-8ffd-34af008f1e38 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.558593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1039/2054] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:04 2022] POST /identity/v3/users => generated 295 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:04.559896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c913-879d-4406-a4a7-83e34e19213b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.572985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0c913-879d-4406-a4a7-83e34e19213b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.578566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d99f3-4538-49c0-814e-ec6e104a4ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.579326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d99f3-4538-49c0-814e-ec6e104a4ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.579508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d99f3-4538-49c0-814e-ec6e104a4ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.579788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d99f3-4538-49c0-814e-ec6e104a4ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.580496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d99f3-4538-49c0-814e-ec6e104a4ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.582177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d99f3-4538-49c0-814e-ec6e104a4ce2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.594165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1016/2055] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:04.598502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4424a0-83e0-46b3-8ffd-34af008f1e38 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.611886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4424a0-83e0-46b3-8ffd-34af008f1e38 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.616942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0c169-081f-4e94-babc-cb56cc7594fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.617874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c169-081f-4e94-babc-cb56cc7594fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.618313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c169-081f-4e94-babc-cb56cc7594fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.618586 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c169-081f-4e94-babc-cb56cc7594fa admin admin] PATH_INFO: `/v3/projects/0b317fdb95ee456f87e42cb9b6ef4259/users/a34b4c80804441c8a850bbce6631a20c/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.634230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0c169-081f-4e94-babc-cb56cc7594fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b317fdb95ee456f87e42cb9b6ef4259, user_id=a34b4c80804441c8a850bbce6631a20c, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.637004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0c169-081f-4e94-babc-cb56cc7594fa admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.650666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1040/2056] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:04 2022] PUT /identity/v3/projects/0b317fdb95ee456f87e42cb9b6ef4259/users/a34b4c80804441c8a850bbce6631a20c/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:04.654596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d99f3-4538-49c0-814e-ec6e104a4ce2 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.665278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d99f3-4538-49c0-814e-ec6e104a4ce2 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.709400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0c169-081f-4e94-babc-cb56cc7594fa admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.711520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-17c0c169-081f-4e94-babc-cb56cc7594fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:04.719595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:04.733921 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c0131-ef41-4c5b-a176-99ba9c3203f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.734902 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0131-ef41-4c5b-a176-99ba9c3203f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.735247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0131-ef41-4c5b-a176-99ba9c3203f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.735604 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556c0131-ef41-4c5b-a176-99ba9c3203f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.736402 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c0131-ef41-4c5b-a176-99ba9c3203f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.738277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556c0131-ef41-4c5b-a176-99ba9c3203f6 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.750115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1017/2057] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:04.753818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c0131-ef41-4c5b-a176-99ba9c3203f6 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.764259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556c0131-ef41-4c5b-a176-99ba9c3203f6 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.769585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc37728-bfe6-41fc-b04f-09522335d6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.770670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc37728-bfe6-41fc-b04f-09522335d6db admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.770670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc37728-bfe6-41fc-b04f-09522335d6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.771131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc37728-bfe6-41fc-b04f-09522335d6db admin admin] PATH_INFO: `/v3/projects/0b317fdb95ee456f87e42cb9b6ef4259/users/a34b4c80804441c8a850bbce6631a20c/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.773022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc37728-bfe6-41fc-b04f-09522335d6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b317fdb95ee456f87e42cb9b6ef4259, user_id=a34b4c80804441c8a850bbce6631a20c, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.775779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc37728-bfe6-41fc-b04f-09522335d6db admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.783995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0c169-081f-4e94-babc-cb56cc7594fa admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:04.787683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1018/2058] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:04 2022] PUT /identity/v3/projects/0b317fdb95ee456f87e42cb9b6ef4259/users/a34b4c80804441c8a850bbce6631a20c/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:04.798920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f81b47-0c93-4049-8d75-db13c7aa9980 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.799205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f81b47-0c93-4049-8d75-db13c7aa9980 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.799482 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f81b47-0c93-4049-8d75-db13c7aa9980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.826335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-03f81b47-0c93-4049-8d75-db13c7aa9980 None None] MFA Rules not processed for user `a34b4c80804441c8a850bbce6631a20c`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:04.827616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-03f81b47-0c93-4049-8d75-db13c7aa9980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:04.846106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:04.846995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:04.847274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:04.847548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] PATH_INFO: `/v3/projects/24fbf2a97f454dfd85e3899fc2d3948e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:04.848757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24fbf2a97f454dfd85e3899fc2d3948e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:04.850736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:04.902312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24fbf2a97f454dfd85e3899fc2d3948e', 'request_id': 'req-7abd0558-90c3-43a1-9048-58ab5fc52193'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:04.912329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24fbf2a97f454dfd85e3899fc2d3948e', 'request_id': 'req-7abd0558-90c3-43a1-9048-58ab5fc52193'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:04.916843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1019/2059] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:04.919750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24fbf2a97f454dfd85e3899fc2d3948e', 'request_id': 'req-7abd0558-90c3-43a1-9048-58ab5fc52193'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:04.929438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f81b47-0c93-4049-8d75-db13c7aa9980 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.931054 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-03f81b47-0c93-4049-8d75-db13c7aa9980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:04.935020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] The token cache is being invalidate because project 24fbf2a97f454dfd85e3899fc2d3948e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:04.935425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:04.936083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:04.942872 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1041/2060] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:04 2022] DELETE /identity/v3/projects/24fbf2a97f454dfd85e3899fc2d3948e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:04.944422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:04.946431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:04.996858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f81b47-0c93-4049-8d75-db13c7aa9980 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:05.002529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:05.004636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:05.037035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd0558-90c3-43a1-9048-58ab5fc52193 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:05.043694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:05.045551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.045982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.046198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] PATH_INFO: `/v3/users/7b2bd0bab6fb442c86d453f3bf29cb01` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.047487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b2bd0bab6fb442c86d453f3bf29cb01)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:05.049456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:05.063686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5526a4c-7cfe-4f6a-90c9-e572744377ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:05.065189 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5526a4c-7cfe-4f6a-90c9-e572744377ef service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.065479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5526a4c-7cfe-4f6a-90c9-e572744377ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.065760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5526a4c-7cfe-4f6a-90c9-e572744377ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.068267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b5526a4c-7cfe-4f6a-90c9-e572744377ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:05.115549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b2bd0bab6fb442c86d453f3bf29cb01'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:05.122766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b2bd0bab6fb442c86d453f3bf29cb01'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:05.123528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b2bd0bab6fb442c86d453f3bf29cb01'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:05.137188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b2bd0bab6fb442c86d453f3bf29cb01'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:05.141800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5526a4c-7cfe-4f6a-90c9-e572744377ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:05.143355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5526a4c-7cfe-4f6a-90c9-e572744377ef service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:05.145174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b2bd0bab6fb442c86d453f3bf29cb01'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:05.151845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1042/2061] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:04 2022] DELETE /identity/v3/users/7b2bd0bab6fb442c86d453f3bf29cb01 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:05.154996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1020/2062] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:05.197936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:05.199578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:05.265598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bcdd2-4683-4dbb-957a-4f4e7287f080 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:05.272429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599e9d17-6490-418f-bfbd-0473090c24c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:05.273206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9d17-6490-418f-bfbd-0473090c24c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.274149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9d17-6490-418f-bfbd-0473090c24c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.274435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e9d17-6490-418f-bfbd-0473090c24c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.276444 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-599e9d17-6490-418f-bfbd-0473090c24c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:05.401585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e9d17-6490-418f-bfbd-0473090c24c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:05.403912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599e9d17-6490-418f-bfbd-0473090c24c0 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:05.421589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1043/2063] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:05.532424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5526a4c-7cfe-4f6a-90c9-e572744377ef service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:05.551522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5526a4c-7cfe-4f6a-90c9-e572744377ef service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:05.696484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:05.697708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.698189 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.698508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] PATH_INFO: `/v3/projects/864b5146dba044b5b2f0b2a0f36289e9` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.701092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=864b5146dba044b5b2f0b2a0f36289e9)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:05.703914 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:05.779397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '864b5146dba044b5b2f0b2a0f36289e9', 'request_id': 'req-e04f1b51-75b1-45d7-acb6-eba25f5c6885'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:05.790262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '864b5146dba044b5b2f0b2a0f36289e9', 'request_id': 'req-e04f1b51-75b1-45d7-acb6-eba25f5c6885'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:05.799605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '864b5146dba044b5b2f0b2a0f36289e9', 'request_id': 'req-e04f1b51-75b1-45d7-acb6-eba25f5c6885'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:05.801408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:05.817775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] The token cache is being invalidate because project 864b5146dba044b5b2f0b2a0f36289e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:05.818351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:05.819423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e04f1b51-75b1-45d7-acb6-eba25f5c6885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:05.821508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1021/2064] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:05 2022] DELETE /identity/v3/projects/864b5146dba044b5b2f0b2a0f36289e9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:05.828363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c3c40-3043-464f-8d69-52c6b7f1717b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.828650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c3c40-3043-464f-8d69-52c6b7f1717b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.828926 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c3c40-3043-464f-8d69-52c6b7f1717b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:05.849048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-104c3c40-3043-464f-8d69-52c6b7f1717b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:05.850344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-104c3c40-3043-464f-8d69-52c6b7f1717b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:05.861906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:05.976334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1044/2065] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:05.985137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9b94-3100-42cd-b5a1-c06b95cb00e0 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:05.985427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9b94-3100-42cd-b5a1-c06b95cb00e0 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:05.985706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab9b94-3100-42cd-b5a1-c06b95cb00e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.009574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-5bab9b94-3100-42cd-b5a1-c06b95cb00e0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:06.011258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5bab9b94-3100-42cd-b5a1-c06b95cb00e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:06.022143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1022/2066] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:06.026571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c3c40-3043-464f-8d69-52c6b7f1717b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.037954 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c3c40-3043-464f-8d69-52c6b7f1717b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.042960 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dc0f3-74c4-4264-9aba-d432050783bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.043623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dc0f3-74c4-4264-9aba-d432050783bf admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.044044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dc0f3-74c4-4264-9aba-d432050783bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.044255 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dc0f3-74c4-4264-9aba-d432050783bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.045127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dc0f3-74c4-4264-9aba-d432050783bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:06.045488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dc0f3-74c4-4264-9aba-d432050783bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.047450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dc0f3-74c4-4264-9aba-d432050783bf admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.060828 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1045/2067] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:06.065588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab9b94-3100-42cd-b5a1-c06b95cb00e0 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.079732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab9b94-3100-42cd-b5a1-c06b95cb00e0 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.085194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bcaf7-76ee-47ab-983c-115a7df8e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.085956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bcaf7-76ee-47ab-983c-115a7df8e852 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.086374 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bcaf7-76ee-47ab-983c-115a7df8e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.086929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1bcaf7-76ee-47ab-983c-115a7df8e852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.087891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bcaf7-76ee-47ab-983c-115a7df8e852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.090222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1bcaf7-76ee-47ab-983c-115a7df8e852 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.123101 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1023/2068] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:06 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:06.128143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dc0f3-74c4-4264-9aba-d432050783bf admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.140826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dc0f3-74c4-4264-9aba-d432050783bf admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.218577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037464c6-40f1-4e4d-a7ce-4fbb3230b811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.225515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037464c6-40f1-4e4d-a7ce-4fbb3230b811 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.225810 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037464c6-40f1-4e4d-a7ce-4fbb3230b811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.237562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037464c6-40f1-4e4d-a7ce-4fbb3230b811 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.238613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037464c6-40f1-4e4d-a7ce-4fbb3230b811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.241652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037464c6-40f1-4e4d-a7ce-4fbb3230b811 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.269685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1046/2069] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:06 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:06.274338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bcaf7-76ee-47ab-983c-115a7df8e852 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.285450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1bcaf7-76ee-47ab-983c-115a7df8e852 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.292160 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7f9d7-08e1-42dd-ab84-f1f7c3f6ec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.293416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f9d7-08e1-42dd-ab84-f1f7c3f6ec88 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.293416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f9d7-08e1-42dd-ab84-f1f7c3f6ec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.294442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7f9d7-08e1-42dd-ab84-f1f7c3f6ec88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.294928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7f9d7-08e1-42dd-ab84-f1f7c3f6ec88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.296535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b7f9d7-08e1-42dd-ab84-f1f7c3f6ec88 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.308869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1024/2070] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:06.313404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037464c6-40f1-4e4d-a7ce-4fbb3230b811 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.324802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037464c6-40f1-4e4d-a7ce-4fbb3230b811 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.330703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db1e415-2196-42db-a791-7163748314dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.331369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1e415-2196-42db-a791-7163748314dd admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.331652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1e415-2196-42db-a791-7163748314dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.331938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db1e415-2196-42db-a791-7163748314dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.332658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1e415-2196-42db-a791-7163748314dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.334310 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db1e415-2196-42db-a791-7163748314dd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.345028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1047/2071] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:06.349473 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7f9d7-08e1-42dd-ab84-f1f7c3f6ec88 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.359462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7f9d7-08e1-42dd-ab84-f1f7c3f6ec88 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.364487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a22b1-9fae-4833-8d70-919f3a91a28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.365340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a22b1-9fae-4833-8d70-919f3a91a28f admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.365621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a22b1-9fae-4833-8d70-919f3a91a28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.365896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2a22b1-9fae-4833-8d70-919f3a91a28f admin admin] PATH_INFO: `/v3/projects/41e13a72ffff4386ad1b02a4f1f12946/users/e573342bda4042a58694b4781d141da2/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.381369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a22b1-9fae-4833-8d70-919f3a91a28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=41e13a72ffff4386ad1b02a4f1f12946, user_id=e573342bda4042a58694b4781d141da2, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.384328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2a22b1-9fae-4833-8d70-919f3a91a28f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.399620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1025/2072] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:06 2022] PUT /identity/v3/projects/41e13a72ffff4386ad1b02a4f1f12946/users/e573342bda4042a58694b4781d141da2/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:06.409897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b680c2-755f-484b-b269-04cc831d219d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.410225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b680c2-755f-484b-b269-04cc831d219d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.410505 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b680c2-755f-484b-b269-04cc831d219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.439286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-68b680c2-755f-484b-b269-04cc831d219d None None] MFA Rules not processed for user `e573342bda4042a58694b4781d141da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:06.440426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-68b680c2-755f-484b-b269-04cc831d219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:06.515107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1048/2073] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:06.516232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a22b1-9fae-4833-8d70-919f3a91a28f admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.581371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2a22b1-9fae-4833-8d70-919f3a91a28f admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.586416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51211b28-d0c3-49b3-aafe-4bbbda49fa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.587074 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51211b28-d0c3-49b3-aafe-4bbbda49fa55 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.587358 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51211b28-d0c3-49b3-aafe-4bbbda49fa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.587628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51211b28-d0c3-49b3-aafe-4bbbda49fa55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.588358 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51211b28-d0c3-49b3-aafe-4bbbda49fa55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.590440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51211b28-d0c3-49b3-aafe-4bbbda49fa55 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.617513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1026/2074] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:06 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:06.621568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b680c2-755f-484b-b269-04cc831d219d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.634829 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b680c2-755f-484b-b269-04cc831d219d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.643217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:06.715022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991ef7-1c82-4cd0-984c-7299622ad98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.715959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991ef7-1c82-4cd0-984c-7299622ad98d admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.716244 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991ef7-1c82-4cd0-984c-7299622ad98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.716519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb991ef7-1c82-4cd0-984c-7299622ad98d admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.717370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb991ef7-1c82-4cd0-984c-7299622ad98d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.719415 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb991ef7-1c82-4cd0-984c-7299622ad98d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.751875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1049/2075] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:06 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:06.759002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51211b28-d0c3-49b3-aafe-4bbbda49fa55 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.770885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51211b28-d0c3-49b3-aafe-4bbbda49fa55 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.775669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa000b-3e0d-4cf3-9d25-7fea87462e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.776396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa000b-3e0d-4cf3-9d25-7fea87462e21 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.776682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa000b-3e0d-4cf3-9d25-7fea87462e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.779417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa000b-3e0d-4cf3-9d25-7fea87462e21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.779417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa000b-3e0d-4cf3-9d25-7fea87462e21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.779649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa000b-3e0d-4cf3-9d25-7fea87462e21 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.790810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1027/2076] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:06.795409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991ef7-1c82-4cd0-984c-7299622ad98d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.806545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb991ef7-1c82-4cd0-984c-7299622ad98d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.812209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed1459-459f-4967-bd30-91ecb7783f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.813079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed1459-459f-4967-bd30-91ecb7783f16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.813362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed1459-459f-4967-bd30-91ecb7783f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.813636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed1459-459f-4967-bd30-91ecb7783f16 admin admin] PATH_INFO: `/v3/projects/6a18334808f84cc29accf82e15df2bd7/users/6396049a35744398a146c0f8fac7f148/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.829536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed1459-459f-4967-bd30-91ecb7783f16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a18334808f84cc29accf82e15df2bd7, user_id=6396049a35744398a146c0f8fac7f148, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.832350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed1459-459f-4967-bd30-91ecb7783f16 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.857968 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1050/2077] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:06 2022] PUT /identity/v3/projects/6a18334808f84cc29accf82e15df2bd7/users/6396049a35744398a146c0f8fac7f148/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:06.866560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa000b-3e0d-4cf3-9d25-7fea87462e21 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.877964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa000b-3e0d-4cf3-9d25-7fea87462e21 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.942076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bb584b-f974-4597-beae-9e5b8bc4828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.942775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb584b-f974-4597-beae-9e5b8bc4828f admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.943058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb584b-f974-4597-beae-9e5b8bc4828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.943364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bb584b-f974-4597-beae-9e5b8bc4828f admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.944089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb584b-f974-4597-beae-9e5b8bc4828f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.945813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bb584b-f974-4597-beae-9e5b8bc4828f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:06.951300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:06.957246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1028/2078] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:06.961366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed1459-459f-4967-bd30-91ecb7783f16 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:06.973066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed1459-459f-4967-bd30-91ecb7783f16 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:06.984093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caefd39-18eb-4dd6-8fe7-c8ab4f71990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:06.984999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caefd39-18eb-4dd6-8fe7-c8ab4f71990a admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:06.985282 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caefd39-18eb-4dd6-8fe7-c8ab4f71990a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:06.985555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caefd39-18eb-4dd6-8fe7-c8ab4f71990a admin admin] PATH_INFO: `/v3/projects/6a18334808f84cc29accf82e15df2bd7/users/6396049a35744398a146c0f8fac7f148/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:06.987593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caefd39-18eb-4dd6-8fe7-c8ab4f71990a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a18334808f84cc29accf82e15df2bd7, user_id=6396049a35744398a146c0f8fac7f148, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:06.990514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caefd39-18eb-4dd6-8fe7-c8ab4f71990a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.002670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1051/2079] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:06 2022] PUT /identity/v3/projects/6a18334808f84cc29accf82e15df2bd7/users/6396049a35744398a146c0f8fac7f148/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:07.014343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062aa4-de00-4b85-bf4a-76d402620c0b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.014895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062aa4-de00-4b85-bf4a-76d402620c0b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.014895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f062aa4-de00-4b85-bf4a-76d402620c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.045355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9f062aa4-de00-4b85-bf4a-76d402620c0b None None] MFA Rules not processed for user `6396049a35744398a146c0f8fac7f148`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:07.047380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9f062aa4-de00-4b85-bf4a-76d402620c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:07.130199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1029/2080] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:07.140382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caefd39-18eb-4dd6-8fe7-c8ab4f71990a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.142622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4caefd39-18eb-4dd6-8fe7-c8ab4f71990a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:07.216457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caefd39-18eb-4dd6-8fe7-c8ab4f71990a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.221283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef4b9c-c176-48bc-9f27-fb57fb4f581a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.222003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4b9c-c176-48bc-9f27-fb57fb4f581a service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.222380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4b9c-c176-48bc-9f27-fb57fb4f581a service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.222718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef4b9c-c176-48bc-9f27-fb57fb4f581a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.232314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef4b9c-c176-48bc-9f27-fb57fb4f581a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.233820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef4b9c-c176-48bc-9f27-fb57fb4f581a service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.243614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1052/2081] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:07.627145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f062aa4-de00-4b85-bf4a-76d402620c0b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.695010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f062aa4-de00-4b85-bf4a-76d402620c0b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.700676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.701603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.702254 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.702535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] PATH_INFO: `/v3/users/e573342bda4042a58694b4781d141da2` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.703765 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e573342bda4042a58694b4781d141da2)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.705773 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.753688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e573342bda4042a58694b4781d141da2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:07.754282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e573342bda4042a58694b4781d141da2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:07.755113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e573342bda4042a58694b4781d141da2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:07.768419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e573342bda4042a58694b4781d141da2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:07.775362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e573342bda4042a58694b4781d141da2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:07.785201 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:07.790142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1030/2082] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:07 2022] DELETE /identity/v3/users/e573342bda4042a58694b4781d141da2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:07.794634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfd91a-32bd-4867-a84f-a5043f54de05 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.795090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfd91a-32bd-4867-a84f-a5043f54de05 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.795214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfd91a-32bd-4867-a84f-a5043f54de05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.813862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-21cfd91a-32bd-4867-a84f-a5043f54de05 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:07.815099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-21cfd91a-32bd-4867-a84f-a5043f54de05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:07.875193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1053/2083] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:07.884875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:07.886340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:07.949062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd54f93-bcd0-41e0-920a-537f2816aa9d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:07.953204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55e5b-3b4d-4a56-94ac-c9713250700b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:07.953894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55e5b-3b4d-4a56-94ac-c9713250700b service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:07.954202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55e5b-3b4d-4a56-94ac-c9713250700b service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:07.954477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55e5b-3b4d-4a56-94ac-c9713250700b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:07.965533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc55e5b-3b4d-4a56-94ac-c9713250700b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:07.967447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc55e5b-3b4d-4a56-94ac-c9713250700b service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:07.979116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1031/2084] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:08.386637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfd91a-32bd-4867-a84f-a5043f54de05 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:08.388075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-21cfd91a-32bd-4867-a84f-a5043f54de05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.402168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfd91a-32bd-4867-a84f-a5043f54de05 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:08.407484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:08.408377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.408801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.409086 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] PATH_INFO: `/v3/projects/41e13a72ffff4386ad1b02a4f1f12946` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.410297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=41e13a72ffff4386ad1b02a4f1f12946)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:08.412237 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:08.414761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:08.476395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41e13a72ffff4386ad1b02a4f1f12946', 'request_id': 'req-5434f51b-4025-456e-9d14-27bae7db91ad'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.484689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41e13a72ffff4386ad1b02a4f1f12946', 'request_id': 'req-5434f51b-4025-456e-9d14-27bae7db91ad'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.491179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41e13a72ffff4386ad1b02a4f1f12946', 'request_id': 'req-5434f51b-4025-456e-9d14-27bae7db91ad'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.503825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] The token cache is being invalidate because project 41e13a72ffff4386ad1b02a4f1f12946 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:08.504116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.504771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.506491 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1054/2085] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:08 2022] DELETE /identity/v3/projects/41e13a72ffff4386ad1b02a4f1f12946 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:08.510814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55e5b-3b4d-4a56-94ac-c9713250700b service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:08.525589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55e5b-3b4d-4a56-94ac-c9713250700b service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:08.539661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:08.541405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.596338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:08.597394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.598279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.598391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] PATH_INFO: `/v3/users/6396049a35744398a146c0f8fac7f148` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.599723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6396049a35744398a146c0f8fac7f148)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:08.601799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:08.617832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434f51b-4025-456e-9d14-27bae7db91ad admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:08.622845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:08.624419 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.624703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.624978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] PATH_INFO: `/v3/users/98c3c554b28348e2988b118433527df9` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.626228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98c3c554b28348e2988b118433527df9)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:08.628186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:08.666839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6396049a35744398a146c0f8fac7f148'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.667640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6396049a35744398a146c0f8fac7f148'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.669175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6396049a35744398a146c0f8fac7f148'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.683899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6396049a35744398a146c0f8fac7f148'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.692724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98c3c554b28348e2988b118433527df9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.693112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f84dd5d3-491a-4d37-a9fb-1a54df219101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6396049a35744398a146c0f8fac7f148'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.705066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98c3c554b28348e2988b118433527df9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.705956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98c3c554b28348e2988b118433527df9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.717434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1032/2086] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:08 2022] DELETE /identity/v3/users/6396049a35744398a146c0f8fac7f148 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:08.722169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98c3c554b28348e2988b118433527df9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.731421 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98c3c554b28348e2988b118433527df9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:08.738935 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1055/2087] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:08 2022] DELETE /identity/v3/users/98c3c554b28348e2988b118433527df9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:08.743790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8953cc-3077-4219-b69e-0db9ea6836dc None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.744336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8953cc-3077-4219-b69e-0db9ea6836dc None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.744656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8953cc-3077-4219-b69e-0db9ea6836dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.764021 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-cb8953cc-3077-4219-b69e-0db9ea6836dc None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:08.766588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-cb8953cc-3077-4219-b69e-0db9ea6836dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.783326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:08.832647 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1033/2088] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:08.843650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:08.845435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:08.859141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:08.916532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfacc08-c391-4c8f-b603-4de8cde74776 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:08.927091 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f247756-3c09-41a9-afcc-b6c84f224f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:08.929250 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247756-3c09-41a9-afcc-b6c84f224f7d service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:08.929629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247756-3c09-41a9-afcc-b6c84f224f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:08.929916 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f247756-3c09-41a9-afcc-b6c84f224f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:08.942229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247756-3c09-41a9-afcc-b6c84f224f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:08.943679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f247756-3c09-41a9-afcc-b6c84f224f7d service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:08.954696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1056/2089] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:09.085737 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8953cc-3077-4219-b69e-0db9ea6836dc None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.087272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-cb8953cc-3077-4219-b69e-0db9ea6836dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:09.129748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8953cc-3077-4219-b69e-0db9ea6836dc None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.137131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.138324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.138828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.139394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] PATH_INFO: `/v3/projects/6a18334808f84cc29accf82e15df2bd7` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.141311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a18334808f84cc29accf82e15df2bd7)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.143549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.208839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a18334808f84cc29accf82e15df2bd7', 'request_id': 'req-dba32458-81f5-4278-8a95-5de7174e85a2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.218410 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a18334808f84cc29accf82e15df2bd7', 'request_id': 'req-dba32458-81f5-4278-8a95-5de7174e85a2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.227645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a18334808f84cc29accf82e15df2bd7', 'request_id': 'req-dba32458-81f5-4278-8a95-5de7174e85a2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.248216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] The token cache is being invalidate because project 6a18334808f84cc29accf82e15df2bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:09.250211 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.250931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.255903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1034/2090] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:09 2022] DELETE /identity/v3/projects/6a18334808f84cc29accf82e15df2bd7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:09.257828 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7d55-8660-427d-9fe2-89c9bc8f42e0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.258168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7d55-8660-427d-9fe2-89c9bc8f42e0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.258444 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa7d55-8660-427d-9fe2-89c9bc8f42e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.281530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-25fa7d55-8660-427d-9fe2-89c9bc8f42e0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:09.283605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-25fa7d55-8660-427d-9fe2-89c9bc8f42e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:09.319638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.321173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:09.406215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1057/2091] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:09.411763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e096c-1ce5-49ad-a1cd-02ce071b205a None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.412493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e096c-1ce5-49ad-a1cd-02ce071b205a None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.412774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e096c-1ce5-49ad-a1cd-02ce071b205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.432259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba32458-81f5-4278-8a95-5de7174e85a2 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.437821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-586e096c-1ce5-49ad-a1cd-02ce071b205a None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:09.438513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.439496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.439714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-586e096c-1ce5-49ad-a1cd-02ce071b205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:09.440744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.440744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] PATH_INFO: `/v3/projects/cfc17cc60c274865ac5ba02fae92fa4c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.441618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc17cc60c274865ac5ba02fae92fa4c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.443710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.458356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1058/2092] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:09.459605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e096c-1ce5-49ad-a1cd-02ce071b205a None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.480899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586e096c-1ce5-49ad-a1cd-02ce071b205a None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.492673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac958ec9-32e8-4d3a-8a0d-cc8ca436f7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.493341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958ec9-32e8-4d3a-8a0d-cc8ca436f7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.494801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958ec9-32e8-4d3a-8a0d-cc8ca436f7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.494959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958ec9-32e8-4d3a-8a0d-cc8ca436f7a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.496235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac958ec9-32e8-4d3a-8a0d-cc8ca436f7a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:09.496550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac958ec9-32e8-4d3a-8a0d-cc8ca436f7a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.498197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac958ec9-32e8-4d3a-8a0d-cc8ca436f7a3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.511038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:09.513288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc17cc60c274865ac5ba02fae92fa4c', 'request_id': 'req-42365f33-2d67-4db0-9bb5-280a83957408'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.527169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc17cc60c274865ac5ba02fae92fa4c', 'request_id': 'req-42365f33-2d67-4db0-9bb5-280a83957408'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.530709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1059/2093] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:09.533126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac958ec9-32e8-4d3a-8a0d-cc8ca436f7a3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.537601 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc17cc60c274865ac5ba02fae92fa4c', 'request_id': 'req-42365f33-2d67-4db0-9bb5-280a83957408'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.544869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac958ec9-32e8-4d3a-8a0d-cc8ca436f7a3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.560669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] The token cache is being invalidate because project cfc17cc60c274865ac5ba02fae92fa4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:09.560874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.564126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.566027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1035/2094] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:09 2022] DELETE /identity/v3/projects/cfc17cc60c274865ac5ba02fae92fa4c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:09.570415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.572928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:09.638845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74b6c4-1635-4e46-b675-3d385e1367f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.640215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74b6c4-1635-4e46-b675-3d385e1367f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.640597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74b6c4-1635-4e46-b675-3d385e1367f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.641111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74b6c4-1635-4e46-b675-3d385e1367f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.641901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74b6c4-1635-4e46-b675-3d385e1367f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.644832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74b6c4-1635-4e46-b675-3d385e1367f1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.672027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42365f33-2d67-4db0-9bb5-280a83957408 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.678792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.679468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1060/2095] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:09 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:09.680085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.680375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.680661 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] PATH_INFO: `/v3/users/5ba6771fb338470b9f8b03509a898f4a` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.681933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba6771fb338470b9f8b03509a898f4a)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.684003 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.684321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74b6c4-1635-4e46-b675-3d385e1367f1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.686303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9c74b6c4-1635-4e46-b675-3d385e1367f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:09.724556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:09.756260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba6771fb338470b9f8b03509a898f4a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.757305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba6771fb338470b9f8b03509a898f4a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.758030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba6771fb338470b9f8b03509a898f4a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.772014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba6771fb338470b9f8b03509a898f4a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.776876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74b6c4-1635-4e46-b675-3d385e1367f1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.781147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba6771fb338470b9f8b03509a898f4a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:09.782777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56995cf1-494b-4d5c-b271-5ed4248b1e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.783509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995cf1-494b-4d5c-b271-5ed4248b1e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.783732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995cf1-494b-4d5c-b271-5ed4248b1e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.784339 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56995cf1-494b-4d5c-b271-5ed4248b1e64 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.784689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56995cf1-494b-4d5c-b271-5ed4248b1e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.787679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56995cf1-494b-4d5c-b271-5ed4248b1e64 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.798568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1036/2096] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:09 2022] DELETE /identity/v3/users/5ba6771fb338470b9f8b03509a898f4a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:09.811184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1061/2097] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:09 2022] POST /identity/v3/users => generated 293 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:09.815331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.816900 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:09.884810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:09.891534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99f713-4225-40ad-8025-3e5c650c13e4 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.897817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbecd0-eca5-4afc-922c-326081aedc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.898541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbecd0-eca5-4afc-922c-326081aedc27 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.898823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbecd0-eca5-4afc-922c-326081aedc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.899095 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbecd0-eca5-4afc-922c-326081aedc27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.899822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbecd0-eca5-4afc-922c-326081aedc27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.902140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bbecd0-eca5-4afc-922c-326081aedc27 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.913439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1037/2098] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:09.917514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56995cf1-494b-4d5c-b271-5ed4248b1e64 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.928418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56995cf1-494b-4d5c-b271-5ed4248b1e64 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.933770 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc711bd9-3c31-451b-8073-235dac2a9689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.934545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc711bd9-3c31-451b-8073-235dac2a9689 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.934898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc711bd9-3c31-451b-8073-235dac2a9689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.935240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc711bd9-3c31-451b-8073-235dac2a9689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.936577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc711bd9-3c31-451b-8073-235dac2a9689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.938298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc711bd9-3c31-451b-8073-235dac2a9689 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:09.949099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1062/2099] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:09.953581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbecd0-eca5-4afc-922c-326081aedc27 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:09.964096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbecd0-eca5-4afc-922c-326081aedc27 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:09.969530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8ddb7-f652-4410-b583-afdace36ac7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:09.970492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8ddb7-f652-4410-b583-afdace36ac7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:09.970786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8ddb7-f652-4410-b583-afdace36ac7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:09.971070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8ddb7-f652-4410-b583-afdace36ac7c admin admin] PATH_INFO: `/v3/projects/199201a51ce7448292b56b2f69d585bd/users/d57e7f771e0e40a8ab740f77bc04f127/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:09.987001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8ddb7-f652-4410-b583-afdace36ac7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=199201a51ce7448292b56b2f69d585bd, user_id=d57e7f771e0e40a8ab740f77bc04f127, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:09.989699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8ddb7-f652-4410-b583-afdace36ac7c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.004707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1038/2100] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:09 2022] PUT /identity/v3/projects/199201a51ce7448292b56b2f69d585bd/users/d57e7f771e0e40a8ab740f77bc04f127/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:10.015676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3a09e-da18-4bfc-85d6-fcd38591246e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.015968 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3a09e-da18-4bfc-85d6-fcd38591246e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.016248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db3a09e-da18-4bfc-85d6-fcd38591246e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.043280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2db3a09e-da18-4bfc-85d6-fcd38591246e None None] MFA Rules not processed for user `d57e7f771e0e40a8ab740f77bc04f127`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:10.044551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2db3a09e-da18-4bfc-85d6-fcd38591246e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:10.092091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8ddb7-f652-4410-b583-afdace36ac7c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.094156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f5d8ddb7-f652-4410-b583-afdace36ac7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:10.121848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1063/2101] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:10.126977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3a09e-da18-4bfc-85d6-fcd38591246e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.165904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8ddb7-f652-4410-b583-afdace36ac7c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.170700 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.171567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.171846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.172116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] PATH_INFO: `/v3/projects/6bbd0416849f4cb882f1e3eb8428faa5` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.173300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bbd0416849f4cb882f1e3eb8428faa5)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.175252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.196123 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db3a09e-da18-4bfc-85d6-fcd38591246e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.201023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe775160-7145-4116-a8e3-df692efce441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.201826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe775160-7145-4116-a8e3-df692efce441 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.202683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe775160-7145-4116-a8e3-df692efce441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.202997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe775160-7145-4116-a8e3-df692efce441 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.203689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe775160-7145-4116-a8e3-df692efce441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.205594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe775160-7145-4116-a8e3-df692efce441 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.222771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bbd0416849f4cb882f1e3eb8428faa5', 'request_id': 'req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.229931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bbd0416849f4cb882f1e3eb8428faa5', 'request_id': 'req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.232402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1064/2102] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:10 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:10.236805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bbd0416849f4cb882f1e3eb8428faa5', 'request_id': 'req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.236947 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe775160-7145-4116-a8e3-df692efce441 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.247787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] The token cache is being invalidate because project 6bbd0416849f4cb882f1e3eb8428faa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:10.248078 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.249390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.250371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:10.251184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1039/2103] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:10 2022] DELETE /identity/v3/projects/6bbd0416849f4cb882f1e3eb8428faa5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:10.254724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.256115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:10.301417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe775160-7145-4116-a8e3-df692efce441 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.306732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4eb81-97d5-4232-b501-f5a1a3c6f98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.307441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4eb81-97d5-4232-b501-f5a1a3c6f98b admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.307721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4eb81-97d5-4232-b501-f5a1a3c6f98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.307993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee4eb81-97d5-4232-b501-f5a1a3c6f98b admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.308694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4eb81-97d5-4232-b501-f5a1a3c6f98b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.310656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee4eb81-97d5-4232-b501-f5a1a3c6f98b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.315989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:10.319830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0d44e-ec20-4026-b8ae-52a1f09fbbca admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.326205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.327692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.328160 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.328633 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] PATH_INFO: `/v3/users/a34b4c80804441c8a850bbce6631a20c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.330071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a34b4c80804441c8a850bbce6631a20c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.332091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.335284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1065/2104] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:10 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:10.336272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4eb81-97d5-4232-b501-f5a1a3c6f98b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.337883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0ee4eb81-97d5-4232-b501-f5a1a3c6f98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:10.349993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee4eb81-97d5-4232-b501-f5a1a3c6f98b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.354867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbf2f1-ee49-4b5f-b35a-acdf631bf6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.355712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf2f1-ee49-4b5f-b35a-acdf631bf6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.355884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf2f1-ee49-4b5f-b35a-acdf631bf6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.356108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bbf2f1-ee49-4b5f-b35a-acdf631bf6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.356844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbf2f1-ee49-4b5f-b35a-acdf631bf6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.359270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bbf2f1-ee49-4b5f-b35a-acdf631bf6a7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.370437 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1066/2105] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:10.374819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbf2f1-ee49-4b5f-b35a-acdf631bf6a7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.383689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a34b4c80804441c8a850bbce6631a20c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.384353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a34b4c80804441c8a850bbce6631a20c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.384973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a34b4c80804441c8a850bbce6631a20c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.385458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bbf2f1-ee49-4b5f-b35a-acdf631bf6a7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.390316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a75686-cfbb-4ee7-9abf-bad809bd4227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.391196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a75686-cfbb-4ee7-9abf-bad809bd4227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.391486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a75686-cfbb-4ee7-9abf-bad809bd4227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.391767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a75686-cfbb-4ee7-9abf-bad809bd4227 admin admin] PATH_INFO: `/v3/projects/63fef4d396dc4e3ca46658a80d5d5ee7/users/2e78617ba49b49fb95f3c7e8db07f9c3/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.398824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a34b4c80804441c8a850bbce6631a20c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.406905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a34b4c80804441c8a850bbce6631a20c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.407150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a75686-cfbb-4ee7-9abf-bad809bd4227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fef4d396dc4e3ca46658a80d5d5ee7, user_id=2e78617ba49b49fb95f3c7e8db07f9c3, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.409929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a75686-cfbb-4ee7-9abf-bad809bd4227 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.419799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1040/2106] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:10 2022] DELETE /identity/v3/users/a34b4c80804441c8a850bbce6631a20c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:10.423359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1067/2107] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:10 2022] PUT /identity/v3/projects/63fef4d396dc4e3ca46658a80d5d5ee7/users/2e78617ba49b49fb95f3c7e8db07f9c3/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:10.427072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.428852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:10.500282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09024d-7a3f-4718-b045-00059b2d247e admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.505340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045774ee-2138-42e3-8eab-4b5eed2c88e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.506017 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045774ee-2138-42e3-8eab-4b5eed2c88e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.506328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045774ee-2138-42e3-8eab-4b5eed2c88e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.506607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045774ee-2138-42e3-8eab-4b5eed2c88e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.507602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045774ee-2138-42e3-8eab-4b5eed2c88e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.509213 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045774ee-2138-42e3-8eab-4b5eed2c88e3 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.520399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1041/2108] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:10.524323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a75686-cfbb-4ee7-9abf-bad809bd4227 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.606117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a75686-cfbb-4ee7-9abf-bad809bd4227 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.612067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255f9c4-166f-4472-a599-7c9db221a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.612966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255f9c4-166f-4472-a599-7c9db221a59f admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.613251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255f9c4-166f-4472-a599-7c9db221a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.613528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255f9c4-166f-4472-a599-7c9db221a59f admin admin] PATH_INFO: `/v3/projects/63fef4d396dc4e3ca46658a80d5d5ee7/users/2e78617ba49b49fb95f3c7e8db07f9c3/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.615940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255f9c4-166f-4472-a599-7c9db221a59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=63fef4d396dc4e3ca46658a80d5d5ee7, user_id=2e78617ba49b49fb95f3c7e8db07f9c3, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.618854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b255f9c4-166f-4472-a599-7c9db221a59f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.631405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1068/2109] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:10 2022] PUT /identity/v3/projects/63fef4d396dc4e3ca46658a80d5d5ee7/users/2e78617ba49b49fb95f3c7e8db07f9c3/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:10.642594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b697bf-ab5b-4b48-a3b8-614ce75d3e76 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.642894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b697bf-ab5b-4b48-a3b8-614ce75d3e76 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.643203 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b697bf-ab5b-4b48-a3b8-614ce75d3e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.671924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-80b697bf-ab5b-4b48-a3b8-614ce75d3e76 None None] MFA Rules not processed for user `2e78617ba49b49fb95f3c7e8db07f9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:10.673170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-80b697bf-ab5b-4b48-a3b8-614ce75d3e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:10.765462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:10.778136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1042/2110] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:10.786053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255f9c4-166f-4472-a599-7c9db221a59f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.787966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b255f9c4-166f-4472-a599-7c9db221a59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:10.808246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b697bf-ab5b-4b48-a3b8-614ce75d3e76 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:10.810030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-80b697bf-ab5b-4b48-a3b8-614ce75d3e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:10.897268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b697bf-ab5b-4b48-a3b8-614ce75d3e76 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.901545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142a94e-ed27-4f3f-a5ce-27a2cfd722a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.902308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a94e-ed27-4f3f-a5ce-27a2cfd722a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.902638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a94e-ed27-4f3f-a5ce-27a2cfd722a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.902638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142a94e-ed27-4f3f-a5ce-27a2cfd722a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.906400 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8142a94e-ed27-4f3f-a5ce-27a2cfd722a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:10.908453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255f9c4-166f-4472-a599-7c9db221a59f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:10.913795 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:10.914739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:10.915027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:10.915332 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] PATH_INFO: `/v3/projects/0b317fdb95ee456f87e42cb9b6ef4259` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:10.916672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b317fdb95ee456f87e42cb9b6ef4259)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.918671 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.922035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:10.985277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a94e-ed27-4f3f-a5ce-27a2cfd722a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:10.986871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142a94e-ed27-4f3f-a5ce-27a2cfd722a4 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:10.990069 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b317fdb95ee456f87e42cb9b6ef4259', 'request_id': 'req-318e27e8-e671-4fa7-87af-2cd8f26355f4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:10.997685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1043/2111] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:44:11.002113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b317fdb95ee456f87e42cb9b6ef4259', 'request_id': 'req-318e27e8-e671-4fa7-87af-2cd8f26355f4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:11.010649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b317fdb95ee456f87e42cb9b6ef4259', 'request_id': 'req-318e27e8-e671-4fa7-87af-2cd8f26355f4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:11.023525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] The token cache is being invalidate because project 0b317fdb95ee456f87e42cb9b6ef4259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:11.023856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:11.024616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-318e27e8-e671-4fa7-87af-2cd8f26355f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:11.026418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1069/2112] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:10 2022] DELETE /identity/v3/projects/0b317fdb95ee456f87e42cb9b6ef4259 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:11.033134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d51c9d-0904-425a-9877-1b182d86074d None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.033648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d51c9d-0904-425a-9877-1b182d86074d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.034004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d51c9d-0904-425a-9877-1b182d86074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.055920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-87d51c9d-0904-425a-9877-1b182d86074d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:11.057219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-87d51c9d-0904-425a-9877-1b182d86074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:11.134414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1044/2113] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:11.143247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57ff9-ee3f-4d03-8b59-a841a4f2bfd4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.143540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57ff9-ee3f-4d03-8b59-a841a4f2bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.143863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc57ff9-ee3f-4d03-8b59-a841a4f2bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.170654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-abc57ff9-ee3f-4d03-8b59-a841a4f2bfd4 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:11.171910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-abc57ff9-ee3f-4d03-8b59-a841a4f2bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:11.180532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1070/2114] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:11.185028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d51c9d-0904-425a-9877-1b182d86074d None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.194792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d51c9d-0904-425a-9877-1b182d86074d None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.200205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0853ea-dd4e-449e-8326-8e32a73c3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.200870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0853ea-dd4e-449e-8326-8e32a73c3da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.201190 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0853ea-dd4e-449e-8326-8e32a73c3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.201426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0853ea-dd4e-449e-8326-8e32a73c3da1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.202713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0853ea-dd4e-449e-8326-8e32a73c3da1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:11.203020 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0853ea-dd4e-449e-8326-8e32a73c3da1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.204676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0853ea-dd4e-449e-8326-8e32a73c3da1 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.222118 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1045/2115] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:11.224653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57ff9-ee3f-4d03-8b59-a841a4f2bfd4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.256727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc57ff9-ee3f-4d03-8b59-a841a4f2bfd4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.262896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba96987-390d-4bb7-9102-94a4ad1eedda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.263696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba96987-390d-4bb7-9102-94a4ad1eedda admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.263946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba96987-390d-4bb7-9102-94a4ad1eedda admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.264977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba96987-390d-4bb7-9102-94a4ad1eedda admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.265672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba96987-390d-4bb7-9102-94a4ad1eedda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.267645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba96987-390d-4bb7-9102-94a4ad1eedda admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.299514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1071/2116] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:11 2022] POST /identity/v3/projects => generated 367 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:11.300683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0853ea-dd4e-449e-8326-8e32a73c3da1 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.312164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0853ea-dd4e-449e-8326-8e32a73c3da1 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.355522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:11.378094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1aafd-816b-4376-b2ed-d515610c5275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.378784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1aafd-816b-4376-b2ed-d515610c5275 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.379067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1aafd-816b-4376-b2ed-d515610c5275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.379345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1aafd-816b-4376-b2ed-d515610c5275 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.380233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1aafd-816b-4376-b2ed-d515610c5275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.382273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1aafd-816b-4376-b2ed-d515610c5275 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.415416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1046/2117] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:11 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:11.415503 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba96987-390d-4bb7-9102-94a4ad1eedda admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.425118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba96987-390d-4bb7-9102-94a4ad1eedda admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.429889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736b5b0-ada8-4aa3-ad74-a0b42786af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.430615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b5b0-ada8-4aa3-ad74-a0b42786af63 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.430878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b5b0-ada8-4aa3-ad74-a0b42786af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.431162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736b5b0-ada8-4aa3-ad74-a0b42786af63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.432023 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736b5b0-ada8-4aa3-ad74-a0b42786af63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.433511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736b5b0-ada8-4aa3-ad74-a0b42786af63 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.447498 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1072/2118] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:11.451272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1aafd-816b-4376-b2ed-d515610c5275 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.461869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1aafd-816b-4376-b2ed-d515610c5275 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.466699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3f8cc-e77c-4535-8870-b6dfce8c2a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.467422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3f8cc-e77c-4535-8870-b6dfce8c2a71 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.467718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3f8cc-e77c-4535-8870-b6dfce8c2a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.467989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3f8cc-e77c-4535-8870-b6dfce8c2a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.468910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3f8cc-e77c-4535-8870-b6dfce8c2a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.470779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3f8cc-e77c-4535-8870-b6dfce8c2a71 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.481184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1047/2119] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:11.485570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736b5b0-ada8-4aa3-ad74-a0b42786af63 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.497075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736b5b0-ada8-4aa3-ad74-a0b42786af63 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.502896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6361474-75d9-4287-aee6-241cf584ebbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.503775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6361474-75d9-4287-aee6-241cf584ebbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.504049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6361474-75d9-4287-aee6-241cf584ebbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.504317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6361474-75d9-4287-aee6-241cf584ebbd admin admin] PATH_INFO: `/v3/projects/550a2b4fe947443b9eea475a22f933e8/users/599de44376e24815af26fe3bdb550e2f/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.522231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6361474-75d9-4287-aee6-241cf584ebbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=550a2b4fe947443b9eea475a22f933e8, user_id=599de44376e24815af26fe3bdb550e2f, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.524895 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6361474-75d9-4287-aee6-241cf584ebbd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.537625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1073/2120] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:11 2022] PUT /identity/v3/projects/550a2b4fe947443b9eea475a22f933e8/users/599de44376e24815af26fe3bdb550e2f/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:11.549703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973978-449c-4772-a5f0-4e7d033b7fb6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.549990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973978-449c-4772-a5f0-4e7d033b7fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.550305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74973978-449c-4772-a5f0-4e7d033b7fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.577476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-74973978-449c-4772-a5f0-4e7d033b7fb6 None None] MFA Rules not processed for user `599de44376e24815af26fe3bdb550e2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:11.578889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-74973978-449c-4772-a5f0-4e7d033b7fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:11.642602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1048/2121] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:11.647033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6361474-75d9-4287-aee6-241cf584ebbd admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.710304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6361474-75d9-4287-aee6-241cf584ebbd admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.714952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55877d3a-ffd7-4a83-8587-fb2e2c33f9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.715601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55877d3a-ffd7-4a83-8587-fb2e2c33f9b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.715879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55877d3a-ffd7-4a83-8587-fb2e2c33f9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.716153 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55877d3a-ffd7-4a83-8587-fb2e2c33f9b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.716844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55877d3a-ffd7-4a83-8587-fb2e2c33f9b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.718819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55877d3a-ffd7-4a83-8587-fb2e2c33f9b0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.743835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1074/2122] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:11 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:11.747913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973978-449c-4772-a5f0-4e7d033b7fb6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.759270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74973978-449c-4772-a5f0-4e7d033b7fb6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.817100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e036fd-ddac-4313-b546-55a1a0e7be5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.817884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e036fd-ddac-4313-b546-55a1a0e7be5e admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.818198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e036fd-ddac-4313-b546-55a1a0e7be5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.818476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e036fd-ddac-4313-b546-55a1a0e7be5e admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.819181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e036fd-ddac-4313-b546-55a1a0e7be5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.821788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e036fd-ddac-4313-b546-55a1a0e7be5e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.844484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1049/2123] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:11 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:11.846031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55877d3a-ffd7-4a83-8587-fb2e2c33f9b0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.857642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55877d3a-ffd7-4a83-8587-fb2e2c33f9b0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.862904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca6e2f-d931-4f18-96b6-68047c726272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.863737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca6e2f-d931-4f18-96b6-68047c726272 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.864032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca6e2f-d931-4f18-96b6-68047c726272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.864313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ca6e2f-d931-4f18-96b6-68047c726272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.865085 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca6e2f-d931-4f18-96b6-68047c726272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.866745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ca6e2f-d931-4f18-96b6-68047c726272 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.872394 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:11.879885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1075/2124] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:11.884020 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e036fd-ddac-4313-b546-55a1a0e7be5e admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.895674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e036fd-ddac-4313-b546-55a1a0e7be5e admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:11.900403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed594fe-2fd5-4cdc-ac9d-b44f28bd2095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:11.901395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed594fe-2fd5-4cdc-ac9d-b44f28bd2095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:11.901579 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed594fe-2fd5-4cdc-ac9d-b44f28bd2095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:11.901834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed594fe-2fd5-4cdc-ac9d-b44f28bd2095 admin admin] PATH_INFO: `/v3/projects/f735fd1e97924f34922a733b2bcd9d0c/users/6aaca260719c4e788c7e26161868e3bd/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:11.923356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed594fe-2fd5-4cdc-ac9d-b44f28bd2095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f735fd1e97924f34922a733b2bcd9d0c, user_id=6aaca260719c4e788c7e26161868e3bd, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:11.926033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed594fe-2fd5-4cdc-ac9d-b44f28bd2095 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:11.939297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1050/2125] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:11 2022] PUT /identity/v3/projects/f735fd1e97924f34922a733b2bcd9d0c/users/6aaca260719c4e788c7e26161868e3bd/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:11.944180 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca6e2f-d931-4f18-96b6-68047c726272 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:11.955856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ca6e2f-d931-4f18-96b6-68047c726272 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.014265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d2080-6563-4bf5-aa45-6ffb48a9ee33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.014929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d2080-6563-4bf5-aa45-6ffb48a9ee33 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.015216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d2080-6563-4bf5-aa45-6ffb48a9ee33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.015495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d2080-6563-4bf5-aa45-6ffb48a9ee33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.016220 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d2080-6563-4bf5-aa45-6ffb48a9ee33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:12.017828 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d2080-6563-4bf5-aa45-6ffb48a9ee33 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.027482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1076/2126] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:12.031675 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed594fe-2fd5-4cdc-ac9d-b44f28bd2095 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.042241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed594fe-2fd5-4cdc-ac9d-b44f28bd2095 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.047409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4b5f-fd06-416f-921a-13d7e9e76ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.048287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4b5f-fd06-416f-921a-13d7e9e76ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.048569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4b5f-fd06-416f-921a-13d7e9e76ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.048861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce4b5f-fd06-416f-921a-13d7e9e76ca6 admin admin] PATH_INFO: `/v3/projects/f735fd1e97924f34922a733b2bcd9d0c/users/6aaca260719c4e788c7e26161868e3bd/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.050854 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce4b5f-fd06-416f-921a-13d7e9e76ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f735fd1e97924f34922a733b2bcd9d0c, user_id=6aaca260719c4e788c7e26161868e3bd, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:12.053507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce4b5f-fd06-416f-921a-13d7e9e76ca6 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.060009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:12.066206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1051/2127] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:12 2022] PUT /identity/v3/projects/f735fd1e97924f34922a733b2bcd9d0c/users/6aaca260719c4e788c7e26161868e3bd/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:12.075911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3936a68-feea-46ee-afb0-81d4afcce92e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.076202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3936a68-feea-46ee-afb0-81d4afcce92e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.076482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3936a68-feea-46ee-afb0-81d4afcce92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.103627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a3936a68-feea-46ee-afb0-81d4afcce92e None None] MFA Rules not processed for user `6aaca260719c4e788c7e26161868e3bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:12.104779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a3936a68-feea-46ee-afb0-81d4afcce92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:12.173604 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1077/2128] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:12.185458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4b5f-fd06-416f-921a-13d7e9e76ca6 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.187225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ddce4b5f-fd06-416f-921a-13d7e9e76ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:12.244889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce4b5f-fd06-416f-921a-13d7e9e76ca6 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.248727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c202e10-5f95-4de5-98e6-5c710811e608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.249405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c202e10-5f95-4de5-98e6-5c710811e608 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.249685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c202e10-5f95-4de5-98e6-5c710811e608 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.249959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c202e10-5f95-4de5-98e6-5c710811e608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.259484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c202e10-5f95-4de5-98e6-5c710811e608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:12.260914 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c202e10-5f95-4de5-98e6-5c710811e608 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.270209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1052/2129] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:12.366946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3936a68-feea-46ee-afb0-81d4afcce92e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:12.376739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3936a68-feea-46ee-afb0-81d4afcce92e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:12.380421 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42be58b5-e9ce-4074-b498-51ca33c68bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:12.381215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be58b5-e9ce-4074-b498-51ca33c68bcb service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:12.381495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be58b5-e9ce-4074-b498-51ca33c68bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:12.382015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42be58b5-e9ce-4074-b498-51ca33c68bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:12.460138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be58b5-e9ce-4074-b498-51ca33c68bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:12.461714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42be58b5-e9ce-4074-b498-51ca33c68bcb service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:12.484642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1078/2130] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:12 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:15.430334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c202e10-5f95-4de5-98e6-5c710811e608 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:15.432463 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5c202e10-5f95-4de5-98e6-5c710811e608 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:15.446458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c202e10-5f95-4de5-98e6-5c710811e608 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:15.452932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e7bad-d392-4a87-93be-0e2eda6b77ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:15.453832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7bad-d392-4a87-93be-0e2eda6b77ad service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:15.454179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7bad-d392-4a87-93be-0e2eda6b77ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:15.454476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e7bad-d392-4a87-93be-0e2eda6b77ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:15.456645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-737e7bad-d392-4a87-93be-0e2eda6b77ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:15.539968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e7bad-d392-4a87-93be-0e2eda6b77ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:15.541422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e7bad-d392-4a87-93be-0e2eda6b77ad service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:15.552547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1053/2131] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:17.073170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da187e-f0b5-4429-bb59-de4b50574e35 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:17.073977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da187e-f0b5-4429-bb59-de4b50574e35 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:17.074425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da187e-f0b5-4429-bb59-de4b50574e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:17.101224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d4da187e-f0b5-4429-bb59-de4b50574e35 None None] MFA Rules not processed for user `f838249fe466445b8390013bad0be94a`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:17.102833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d4da187e-f0b5-4429-bb59-de4b50574e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:17.119234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:17.171661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1079/2132] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:17.459023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e7bad-d392-4a87-93be-0e2eda6b77ad service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:17.530965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e7bad-d392-4a87-93be-0e2eda6b77ad service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:17.536035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:17.537086 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:17.537364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:17.537664 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] PATH_INFO: `/v3/users/599de44376e24815af26fe3bdb550e2f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:17.539124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] RBAC: Authorizing `identity:delete_user(user_id=599de44376e24815af26fe3bdb550e2f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:17.541149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:17.599044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:17.607183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599de44376e24815af26fe3bdb550e2f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:17.608408 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599de44376e24815af26fe3bdb550e2f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:17.609791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599de44376e24815af26fe3bdb550e2f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:17.632238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599de44376e24815af26fe3bdb550e2f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:17.650118 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599de44376e24815af26fe3bdb550e2f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:17.683811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1054/2133] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:17 2022] DELETE /identity/v3/users/599de44376e24815af26fe3bdb550e2f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:17.688114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8115c-e042-4dce-9271-f1d58f77d723 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:17.688752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8115c-e042-4dce-9271-f1d58f77d723 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:17.689168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8115c-e042-4dce-9271-f1d58f77d723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:17.716553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-38c8115c-e042-4dce-9271-f1d58f77d723 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:17.720258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-38c8115c-e042-4dce-9271-f1d58f77d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:17.839267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1080/2134] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:17.849255 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:17.852388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:17.951283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4815d2-7b02-485a-a2d3-32827c9a696b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:17.951283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2961e26-e970-4d4a-91ea-2d18857e035c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:17.951283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2961e26-e970-4d4a-91ea-2d18857e035c service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:17.951283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2961e26-e970-4d4a-91ea-2d18857e035c service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:17.952720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2961e26-e970-4d4a-91ea-2d18857e035c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:17.957977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2961e26-e970-4d4a-91ea-2d18857e035c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:17.963828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2961e26-e970-4d4a-91ea-2d18857e035c service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:17.976573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1055/2135] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:18.269601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8115c-e042-4dce-9271-f1d58f77d723 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:18.271044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-38c8115c-e042-4dce-9271-f1d58f77d723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:18.295268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8115c-e042-4dce-9271-f1d58f77d723 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:18.309898 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:18.311725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:18.312013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:18.312292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] PATH_INFO: `/v3/projects/550a2b4fe947443b9eea475a22f933e8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:18.313521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=550a2b4fe947443b9eea475a22f933e8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:18.315468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:18.392024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '550a2b4fe947443b9eea475a22f933e8', 'request_id': 'req-c4d606d7-c49a-4bce-b085-ad3963488e3b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:18.401458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '550a2b4fe947443b9eea475a22f933e8', 'request_id': 'req-c4d606d7-c49a-4bce-b085-ad3963488e3b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:18.409565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '550a2b4fe947443b9eea475a22f933e8', 'request_id': 'req-c4d606d7-c49a-4bce-b085-ad3963488e3b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:18.430367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] The token cache is being invalidate because project 550a2b4fe947443b9eea475a22f933e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:18.430564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:18.431208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c4d606d7-c49a-4bce-b085-ad3963488e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:18.434159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1081/2136] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:18 2022] DELETE /identity/v3/projects/550a2b4fe947443b9eea475a22f933e8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:18.439657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2961e26-e970-4d4a-91ea-2d18857e035c service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:18.462544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2961e26-e970-4d4a-91ea-2d18857e035c service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:18.524346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:18.525475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:18.525763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:18.526040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] PATH_INFO: `/v3/users/6aaca260719c4e788c7e26161868e3bd` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:18.527349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aaca260719c4e788c7e26161868e3bd)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:18.529285 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:18.593390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aaca260719c4e788c7e26161868e3bd'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:18.594828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aaca260719c4e788c7e26161868e3bd'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:18.595568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aaca260719c4e788c7e26161868e3bd'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:18.615774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:18.618788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aaca260719c4e788c7e26161868e3bd'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:18.633016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aaca260719c4e788c7e26161868e3bd'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:18.654271 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1056/2137] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:18 2022] DELETE /identity/v3/users/6aaca260719c4e788c7e26161868e3bd => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:19.087386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d84e4-3b75-4df6-8d20-6b7a6047ddfe None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:19.088223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d84e4-3b75-4df6-8d20-6b7a6047ddfe None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:19.088942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d84e4-3b75-4df6-8d20-6b7a6047ddfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:19.117081 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:19.119033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:19.126790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-345d84e4-3b75-4df6-8d20-6b7a6047ddfe None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:19.130670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-345d84e4-3b75-4df6-8d20-6b7a6047ddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:19.244094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e000bff3-55bf-4b70-ac22-af3724f4fede admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:19.247340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:19.250117 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:19.250973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:19.251323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:19.251697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] PATH_INFO: `/v3/projects/f735fd1e97924f34922a733b2bcd9d0c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:19.253115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f735fd1e97924f34922a733b2bcd9d0c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:19.255503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:19.260986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1082/2138] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:19.313660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d84e4-3b75-4df6-8d20-6b7a6047ddfe None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:19.315361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-345d84e4-3b75-4df6-8d20-6b7a6047ddfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:19.386965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d84e4-3b75-4df6-8d20-6b7a6047ddfe None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:19.393334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f2fbe-f3cc-4e70-84da-e6a43b61f62b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:19.393991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f2fbe-f3cc-4e70-84da-e6a43b61f62b service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:19.394304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f2fbe-f3cc-4e70-84da-e6a43b61f62b service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:19.394582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f2fbe-f3cc-4e70-84da-e6a43b61f62b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:19.412756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f2fbe-f3cc-4e70-84da-e6a43b61f62b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:19.415365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f2fbe-f3cc-4e70-84da-e6a43b61f62b service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:19.427157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1083/2139] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:44:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:44:19.440846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f735fd1e97924f34922a733b2bcd9d0c', 'request_id': 'req-8705a580-0565-48d5-806f-abe31c325869'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:19.453004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f735fd1e97924f34922a733b2bcd9d0c', 'request_id': 'req-8705a580-0565-48d5-806f-abe31c325869'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:19.473783 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f735fd1e97924f34922a733b2bcd9d0c', 'request_id': 'req-8705a580-0565-48d5-806f-abe31c325869'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:19.497381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] The token cache is being invalidate because project f735fd1e97924f34922a733b2bcd9d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:19.497975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:19.499385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8705a580-0565-48d5-806f-abe31c325869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:19.501288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1057/2140] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:19 2022] DELETE /identity/v3/projects/f735fd1e97924f34922a733b2bcd9d0c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:19.507078 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bfe10-5f73-41ec-9122-40f9363a1f94 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:19.507363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bfe10-5f73-41ec-9122-40f9363a1f94 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:19.507806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43bfe10-5f73-41ec-9122-40f9363a1f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:19.550056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a43bfe10-5f73-41ec-9122-40f9363a1f94 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:19.554222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a43bfe10-5f73-41ec-9122-40f9363a1f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:19.686456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1084/2141] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:19.697683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60dc07-dd50-4b42-b7b0-d8a9b60d4841 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:19.697683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60dc07-dd50-4b42-b7b0-d8a9b60d4841 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:19.697683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60dc07-dd50-4b42-b7b0-d8a9b60d4841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:19.729109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9f60dc07-dd50-4b42-b7b0-d8a9b60d4841 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:19.730656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9f60dc07-dd50-4b42-b7b0-d8a9b60d4841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:19.741414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1058/2142] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:19.745987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bfe10-5f73-41ec-9122-40f9363a1f94 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:19.757615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43bfe10-5f73-41ec-9122-40f9363a1f94 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:19.768729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca576f-bc97-425e-aa17-7999512be2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:19.770391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca576f-bc97-425e-aa17-7999512be2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:19.770842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca576f-bc97-425e-aa17-7999512be2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:19.771321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca576f-bc97-425e-aa17-7999512be2bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:19.772405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca576f-bc97-425e-aa17-7999512be2bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:19.772952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca576f-bc97-425e-aa17-7999512be2bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:19.775097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca576f-bc97-425e-aa17-7999512be2bc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:19.798501 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1085/2143] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:19.803338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60dc07-dd50-4b42-b7b0-d8a9b60d4841 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:19.815424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60dc07-dd50-4b42-b7b0-d8a9b60d4841 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:19.824191 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d32711-f645-4fbf-8261-32a992a68434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:19.825378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d32711-f645-4fbf-8261-32a992a68434 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:19.825911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d32711-f645-4fbf-8261-32a992a68434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:19.826525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d32711-f645-4fbf-8261-32a992a68434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:19.827896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d32711-f645-4fbf-8261-32a992a68434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:19.831010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d32711-f645-4fbf-8261-32a992a68434 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:19.889644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1059/2144] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:19 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:19.896127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca576f-bc97-425e-aa17-7999512be2bc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:19.912245 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca576f-bc97-425e-aa17-7999512be2bc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:20.032150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540c08f-4cb1-448f-8487-9085dc92fcc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:20.033113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540c08f-4cb1-448f-8487-9085dc92fcc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:20.033291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540c08f-4cb1-448f-8487-9085dc92fcc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:20.033504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540c08f-4cb1-448f-8487-9085dc92fcc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:20.034470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540c08f-4cb1-448f-8487-9085dc92fcc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:20.036563 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540c08f-4cb1-448f-8487-9085dc92fcc1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:20.056461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:20.070616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1086/2145] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:19 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:20.078257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d32711-f645-4fbf-8261-32a992a68434 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:20.092900 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d32711-f645-4fbf-8261-32a992a68434 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:20.111076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3c56-bacd-42e8-a5c2-f51eae5482c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:20.111832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3c56-bacd-42e8-a5c2-f51eae5482c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:20.112468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3c56-bacd-42e8-a5c2-f51eae5482c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:20.112735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d3c56-bacd-42e8-a5c2-f51eae5482c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:20.113648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d3c56-bacd-42e8-a5c2-f51eae5482c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:20.115515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d3c56-bacd-42e8-a5c2-f51eae5482c3 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:20.130755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1060/2146] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:20.138429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540c08f-4cb1-448f-8487-9085dc92fcc1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:20.161431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540c08f-4cb1-448f-8487-9085dc92fcc1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:20.169567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f36db5-a843-4788-9d10-193262218059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:20.170934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36db5-a843-4788-9d10-193262218059 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:20.171506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36db5-a843-4788-9d10-193262218059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:20.171934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f36db5-a843-4788-9d10-193262218059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:20.176159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f36db5-a843-4788-9d10-193262218059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:20.181210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f36db5-a843-4788-9d10-193262218059 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:20.214223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1087/2147] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:20.215083 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3c56-bacd-42e8-a5c2-f51eae5482c3 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:20.225916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d3c56-bacd-42e8-a5c2-f51eae5482c3 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:20.234152 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cee71e-f715-44ab-8351-b543b28bc0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:20.235071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cee71e-f715-44ab-8351-b543b28bc0db admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:20.235497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cee71e-f715-44ab-8351-b543b28bc0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:20.236985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cee71e-f715-44ab-8351-b543b28bc0db admin admin] PATH_INFO: `/v3/projects/61f778f62ed9422eb258c8b40ef020a0/users/1d4eb494fd8c446895505b0ae6b6f343/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:20.263047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cee71e-f715-44ab-8351-b543b28bc0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f778f62ed9422eb258c8b40ef020a0, user_id=1d4eb494fd8c446895505b0ae6b6f343, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:20.267758 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cee71e-f715-44ab-8351-b543b28bc0db admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:20.289394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1061/2148] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:20 2022] PUT /identity/v3/projects/61f778f62ed9422eb258c8b40ef020a0/users/1d4eb494fd8c446895505b0ae6b6f343/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:20.302040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869842f4-9636-4f65-aaca-382c2d3cd5f6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:20.302425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869842f4-9636-4f65-aaca-382c2d3cd5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:20.302620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869842f4-9636-4f65-aaca-382c2d3cd5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:20.321280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0781-2934-4a38-9e92-5b78285c3398 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:20.321559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0781-2934-4a38-9e92-5b78285c3398 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:20.321895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc0781-2934-4a38-9e92-5b78285c3398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:20.337584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:20.356417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-869842f4-9636-4f65-aaca-382c2d3cd5f6 None None] MFA Rules not processed for user `1d4eb494fd8c446895505b0ae6b6f343`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:20.359680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-869842f4-9636-4f65-aaca-382c2d3cd5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:20.364717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7fbc0781-2934-4a38-9e92-5b78285c3398 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:20.367075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7fbc0781-2934-4a38-9e92-5b78285c3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:20.469533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1062/2149] 10.222.0.79 () {58 vars in 967 bytes} [Wed May 25 14:44:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:20.473503 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1088/2150] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:20.489718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc0781-2934-4a38-9e92-5b78285c3398 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:20.493453 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7fbc0781-2934-4a38-9e92-5b78285c3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:20.503910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869842f4-9636-4f65-aaca-382c2d3cd5f6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:20.506413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-869842f4-9636-4f65-aaca-382c2d3cd5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:20.616307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc0781-2934-4a38-9e92-5b78285c3398 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:20.622739 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109ca5e-8715-47b8-a829-555f848dc6ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:20.624312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109ca5e-8715-47b8-a829-555f848dc6ee service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:20.624742 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109ca5e-8715-47b8-a829-555f848dc6ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:20.626824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109ca5e-8715-47b8-a829-555f848dc6ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:20.641377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109ca5e-8715-47b8-a829-555f848dc6ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:20.643170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109ca5e-8715-47b8-a829-555f848dc6ee service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:20.656676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1063/2151] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:20.665913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869842f4-9636-4f65-aaca-382c2d3cd5f6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:20.676808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61961a48-8ab2-4c5d-824a-6e0fc86b76e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:20.677652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961a48-8ab2-4c5d-824a-6e0fc86b76e1 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:20.678721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961a48-8ab2-4c5d-824a-6e0fc86b76e1 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:20.678721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61961a48-8ab2-4c5d-824a-6e0fc86b76e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:20.691585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61961a48-8ab2-4c5d-824a-6e0fc86b76e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:20.693215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61961a48-8ab2-4c5d-824a-6e0fc86b76e1 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:20.711039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1089/2152] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:44:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:44:20.746939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109ca5e-8715-47b8-a829-555f848dc6ee service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:20.749480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f109ca5e-8715-47b8-a829-555f848dc6ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:20.883476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109ca5e-8715-47b8-a829-555f848dc6ee service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:20.892909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:20.894676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:20.896303 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:20.896303 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] PATH_INFO: `/v3/users/d57e7f771e0e40a8ab740f77bc04f127` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:20.897694 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57e7f771e0e40a8ab740f77bc04f127)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:20.900342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:21.016993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57e7f771e0e40a8ab740f77bc04f127'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:21.017666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57e7f771e0e40a8ab740f77bc04f127'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:21.018320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57e7f771e0e40a8ab740f77bc04f127'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:21.026145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:21.037977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57e7f771e0e40a8ab740f77bc04f127'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:21.073508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a23508b6-028e-49fa-a70a-c2422750594e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57e7f771e0e40a8ab740f77bc04f127'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:21.134901 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1064/2153] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:20 2022] DELETE /identity/v3/users/d57e7f771e0e40a8ab740f77bc04f127 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:21.142218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e47e1-b168-42bc-aca1-548f5bdd539e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:21.142539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e47e1-b168-42bc-aca1-548f5bdd539e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:21.143022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357e47e1-b168-42bc-aca1-548f5bdd539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:21.173848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8ab9a-25bf-4f1a-aca2-b9cd660d04db None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:21.174288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8ab9a-25bf-4f1a-aca2-b9cd660d04db None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:21.174478 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8ab9a-25bf-4f1a-aca2-b9cd660d04db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:21.188389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-357e47e1-b168-42bc-aca1-548f5bdd539e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:21.189592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-357e47e1-b168-42bc-aca1-548f5bdd539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:21.210680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-83f8ab9a-25bf-4f1a-aca2-b9cd660d04db None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:21.211927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-83f8ab9a-25bf-4f1a-aca2-b9cd660d04db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:21.303704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1090/2154] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:21.305698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1065/2155] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:44:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:21.313848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e47e1-b168-42bc-aca1-548f5bdd539e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:21.316246 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-357e47e1-b168-42bc-aca1-548f5bdd539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:21.323885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8ab9a-25bf-4f1a-aca2-b9cd660d04db None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:21.326019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-83f8ab9a-25bf-4f1a-aca2-b9cd660d04db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:21.348827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:21.426145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357e47e1-b168-42bc-aca1-548f5bdd539e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:21.440082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb1daa-30f6-4427-a26e-c4a601cf32f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:21.440981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1daa-30f6-4427-a26e-c4a601cf32f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:21.441467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1daa-30f6-4427-a26e-c4a601cf32f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:21.442325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb1daa-30f6-4427-a26e-c4a601cf32f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:21.449110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8ab9a-25bf-4f1a-aca2-b9cd660d04db None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:21.459329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2169a04-5875-4df8-93cc-7883addbdbfe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:21.460658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2169a04-5875-4df8-93cc-7883addbdbfe service swift] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:21.461160 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2169a04-5875-4df8-93cc-7883addbdbfe service swift] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:21.461462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2169a04-5875-4df8-93cc-7883addbdbfe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:21.464295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb1daa-30f6-4427-a26e-c4a601cf32f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:21.466416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb1daa-30f6-4427-a26e-c4a601cf32f7 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:21.480147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1091/2156] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:21.481119 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2169a04-5875-4df8-93cc-7883addbdbfe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:21.484066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2169a04-5875-4df8-93cc-7883addbdbfe service swift] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:21.502597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1066/2157] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:44:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:44:22.000431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb1daa-30f6-4427-a26e-c4a601cf32f7 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:22.002606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-23eb1daa-30f6-4427-a26e-c4a601cf32f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:22.025952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb1daa-30f6-4427-a26e-c4a601cf32f7 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:22.034882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:22.035752 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:22.036031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:22.036321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] PATH_INFO: `/v3/projects/199201a51ce7448292b56b2f69d585bd` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:22.037692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=199201a51ce7448292b56b2f69d585bd)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:22.039677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:22.104200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '199201a51ce7448292b56b2f69d585bd', 'request_id': 'req-aa76a299-98b7-48dd-8e5e-641be3b08916'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.116117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '199201a51ce7448292b56b2f69d585bd', 'request_id': 'req-aa76a299-98b7-48dd-8e5e-641be3b08916'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.117513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8598-cfd4-47ec-85fe-723eda3900f5 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:22.117874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8598-cfd4-47ec-85fe-723eda3900f5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:22.118287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e8598-cfd4-47ec-85fe-723eda3900f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:22.126313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '199201a51ce7448292b56b2f69d585bd', 'request_id': 'req-aa76a299-98b7-48dd-8e5e-641be3b08916'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.143016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-ae7e8598-cfd4-47ec-85fe-723eda3900f5 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:22.144470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ae7e8598-cfd4-47ec-85fe-723eda3900f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:22.151893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] The token cache is being invalidate because project 199201a51ce7448292b56b2f69d585bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:22.152275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.153010 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.155061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1092/2158] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:21 2022] DELETE /identity/v3/projects/199201a51ce7448292b56b2f69d585bd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:22.158967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:22.161635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:22.212963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1067/2159] 10.222.0.79 () {58 vars in 967 bytes} [Wed May 25 14:44:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:22.230520 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e8598-cfd4-47ec-85fe-723eda3900f5 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:22.233175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ae7e8598-cfd4-47ec-85fe-723eda3900f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:22.243750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa76a299-98b7-48dd-8e5e-641be3b08916 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:22.250484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:22.251257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:22.251538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:22.251843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] PATH_INFO: `/v3/users/2e78617ba49b49fb95f3c7e8db07f9c3` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:22.253247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e78617ba49b49fb95f3c7e8db07f9c3)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:22.255279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:22.259109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:22.320123 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:22.335351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e78617ba49b49fb95f3c7e8db07f9c3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.348058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e78617ba49b49fb95f3c7e8db07f9c3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.348337 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e8598-cfd4-47ec-85fe-723eda3900f5 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:22.348838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e78617ba49b49fb95f3c7e8db07f9c3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.359104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3577a-2401-4f19-9794-ecf50d0858e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:22.360429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3577a-2401-4f19-9794-ecf50d0858e7 service swift] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:22.360784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3577a-2401-4f19-9794-ecf50d0858e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:22.361126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3577a-2401-4f19-9794-ecf50d0858e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:22.371622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e78617ba49b49fb95f3c7e8db07f9c3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.374143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3577a-2401-4f19-9794-ecf50d0858e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:22.376528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f3577a-2401-4f19-9794-ecf50d0858e7 service swift] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:22.382298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e78617ba49b49fb95f3c7e8db07f9c3'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.394138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1068/2160] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:44:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:44:22.394999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1093/2161] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:22 2022] DELETE /identity/v3/users/2e78617ba49b49fb95f3c7e8db07f9c3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:22.785233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3577a-2401-4f19-9794-ecf50d0858e7 service swift] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:22.802917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f3577a-2401-4f19-9794-ecf50d0858e7 service swift] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:22.888909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:22.890378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:22.890927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:22.891116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] PATH_INFO: `/v3/projects/63fef4d396dc4e3ca46658a80d5d5ee7` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:22.893092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63fef4d396dc4e3ca46658a80d5d5ee7)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:22.896714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:22.965114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63fef4d396dc4e3ca46658a80d5d5ee7', 'request_id': 'req-344c149b-173c-48a0-ae02-ec92e6ff4073'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.980448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63fef4d396dc4e3ca46658a80d5d5ee7', 'request_id': 'req-344c149b-173c-48a0-ae02-ec92e6ff4073'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:22.989068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63fef4d396dc4e3ca46658a80d5d5ee7', 'request_id': 'req-344c149b-173c-48a0-ae02-ec92e6ff4073'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:23.014583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] The token cache is being invalidate because project 63fef4d396dc4e3ca46658a80d5d5ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:23.015226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:23.016296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-344c149b-173c-48a0-ae02-ec92e6ff4073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:23.018215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1069/2162] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:22 2022] DELETE /identity/v3/projects/63fef4d396dc4e3ca46658a80d5d5ee7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:24.906938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:24.909038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:24.929215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692340c-36ce-432f-bcf9-7a5baac6b8fe admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:25.009291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:25.010755 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:25.011201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:25.011667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] PATH_INFO: `/v3/users/83722d9ffa5c41d292c56a66ebbd8d17` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:25.014679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83722d9ffa5c41d292c56a66ebbd8d17)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:25.018200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:25.080179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83722d9ffa5c41d292c56a66ebbd8d17'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:25.090987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83722d9ffa5c41d292c56a66ebbd8d17'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:25.092235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83722d9ffa5c41d292c56a66ebbd8d17'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:25.106324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83722d9ffa5c41d292c56a66ebbd8d17'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:25.117294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83722d9ffa5c41d292c56a66ebbd8d17'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:25.126682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1094/2163] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:24 2022] DELETE /identity/v3/users/83722d9ffa5c41d292c56a66ebbd8d17 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:25.131333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1222-4afd-4fc4-9a00-82c4b0502a39 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:25.132225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1222-4afd-4fc4-9a00-82c4b0502a39 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:25.132225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee1222-4afd-4fc4-9a00-82c4b0502a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:25.156797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-55ee1222-4afd-4fc4-9a00-82c4b0502a39 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:25.158219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-55ee1222-4afd-4fc4-9a00-82c4b0502a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:25.200385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:25.264698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1070/2164] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:25.276568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:25.279206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:25.336053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:25.366198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8caae-80be-4a72-836f-e9e555fb2911 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:25.370253 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5100965-1514-439b-a977-921e15532109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:25.370915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5100965-1514-439b-a977-921e15532109 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:25.371227 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5100965-1514-439b-a977-921e15532109 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:25.371505 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5100965-1514-439b-a977-921e15532109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:25.382754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5100965-1514-439b-a977-921e15532109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:25.384219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5100965-1514-439b-a977-921e15532109 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:25.394658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1095/2165] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:25.625236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee1222-4afd-4fc4-9a00-82c4b0502a39 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:25.630706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-55ee1222-4afd-4fc4-9a00-82c4b0502a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:25.659524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee1222-4afd-4fc4-9a00-82c4b0502a39 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:25.668951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:25.671068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:25.671578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:25.672174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] PATH_INFO: `/v3/projects/aeefd3bf1330475998743f2a7561aca2` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:25.674591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeefd3bf1330475998743f2a7561aca2)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:25.679182 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:25.768048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeefd3bf1330475998743f2a7561aca2', 'request_id': 'req-ce5a5e7e-6493-471f-a200-76e0f6a27fea'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:25.776494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeefd3bf1330475998743f2a7561aca2', 'request_id': 'req-ce5a5e7e-6493-471f-a200-76e0f6a27fea'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:25.787629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeefd3bf1330475998743f2a7561aca2', 'request_id': 'req-ce5a5e7e-6493-471f-a200-76e0f6a27fea'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:25.803191 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] The token cache is being invalidate because project aeefd3bf1330475998743f2a7561aca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:25.803652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:25.804652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ce5a5e7e-6493-471f-a200-76e0f6a27fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:25.807115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1071/2166] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:25 2022] DELETE /identity/v3/projects/aeefd3bf1330475998743f2a7561aca2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:25.815368 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e01984-de41-492b-8496-daa384f849c0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:25.815889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e01984-de41-492b-8496-daa384f849c0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:25.816402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e01984-de41-492b-8496-daa384f849c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:25.847809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-48e01984-de41-492b-8496-daa384f849c0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:25.850975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-48e01984-de41-492b-8496-daa384f849c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:25.931549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1096/2167] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:25.941064 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de27158-0c5f-419a-9fd9-5dee093fabc8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:25.941352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de27158-0c5f-419a-9fd9-5dee093fabc8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:25.941629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de27158-0c5f-419a-9fd9-5dee093fabc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:25.962916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-0de27158-0c5f-419a-9fd9-5dee093fabc8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:25.964225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0de27158-0c5f-419a-9fd9-5dee093fabc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:25.972960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1072/2168] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:25.977966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e01984-de41-492b-8496-daa384f849c0 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:25.993705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e01984-de41-492b-8496-daa384f849c0 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:26.000760 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111d91-c319-4521-b731-e9b2993af432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:26.001438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111d91-c319-4521-b731-e9b2993af432 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:26.001722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111d91-c319-4521-b731-e9b2993af432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:26.001999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1111d91-c319-4521-b731-e9b2993af432 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:26.002863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1111d91-c319-4521-b731-e9b2993af432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:26.003208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1111d91-c319-4521-b731-e9b2993af432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:26.004785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1111d91-c319-4521-b731-e9b2993af432 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:26.021414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1097/2169] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:26.025931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de27158-0c5f-419a-9fd9-5dee093fabc8 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:26.037844 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de27158-0c5f-419a-9fd9-5dee093fabc8 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:26.045113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd400-80dd-4802-b541-f9dcf85659bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:26.046375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd400-80dd-4802-b541-f9dcf85659bd admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:26.046699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd400-80dd-4802-b541-f9dcf85659bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:26.047305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acdd400-80dd-4802-b541-f9dcf85659bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:26.048621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd400-80dd-4802-b541-f9dcf85659bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:26.050695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acdd400-80dd-4802-b541-f9dcf85659bd admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:26.112077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1073/2170] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:26 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:26.116797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111d91-c319-4521-b731-e9b2993af432 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:26.128321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1111d91-c319-4521-b731-e9b2993af432 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:26.235991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df02e7-b273-4d2c-97ee-e88d73153875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:26.236660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df02e7-b273-4d2c-97ee-e88d73153875 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:26.236944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df02e7-b273-4d2c-97ee-e88d73153875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:26.237221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df02e7-b273-4d2c-97ee-e88d73153875 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:26.237912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df02e7-b273-4d2c-97ee-e88d73153875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:26.239881 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df02e7-b273-4d2c-97ee-e88d73153875 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:26.261070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1098/2171] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:26 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:26.266425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd400-80dd-4802-b541-f9dcf85659bd admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:26.316262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acdd400-80dd-4802-b541-f9dcf85659bd admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:26.321381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3d33c-986f-40db-bf68-1898e62b0579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:26.322227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d33c-986f-40db-bf68-1898e62b0579 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:26.322617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d33c-986f-40db-bf68-1898e62b0579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:26.322980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3d33c-986f-40db-bf68-1898e62b0579 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:26.323812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3d33c-986f-40db-bf68-1898e62b0579 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:26.325517 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3d33c-986f-40db-bf68-1898e62b0579 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:26.337582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1074/2172] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:26.341459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df02e7-b273-4d2c-97ee-e88d73153875 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:26.359065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df02e7-b273-4d2c-97ee-e88d73153875 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:26.366605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a13264-55a4-4473-9cd3-afe59edc8c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:26.367652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a13264-55a4-4473-9cd3-afe59edc8c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:26.368106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a13264-55a4-4473-9cd3-afe59edc8c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:26.368555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a13264-55a4-4473-9cd3-afe59edc8c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:26.369765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a13264-55a4-4473-9cd3-afe59edc8c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:26.372614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a13264-55a4-4473-9cd3-afe59edc8c67 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:26.383252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:26.398811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1099/2173] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:26.400661 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3d33c-986f-40db-bf68-1898e62b0579 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:26.413234 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3d33c-986f-40db-bf68-1898e62b0579 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:26.418239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39084bd-1a8e-495c-b036-50646169db48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:26.419240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39084bd-1a8e-495c-b036-50646169db48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:26.419585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39084bd-1a8e-495c-b036-50646169db48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:26.419995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39084bd-1a8e-495c-b036-50646169db48 admin admin] PATH_INFO: `/v3/projects/ca6e26136eaf4e3eac9014e5791053f6/users/c8d14796ae864b15821f4b40f78e531d/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:26.439960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39084bd-1a8e-495c-b036-50646169db48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6e26136eaf4e3eac9014e5791053f6, user_id=c8d14796ae864b15821f4b40f78e531d, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:26.443268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39084bd-1a8e-495c-b036-50646169db48 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:26.456565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:26.478839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1075/2174] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:26 2022] PUT /identity/v3/projects/ca6e26136eaf4e3eac9014e5791053f6/users/c8d14796ae864b15821f4b40f78e531d/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:26.485126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764a93-7bea-48ef-8aef-87e0771fec0e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:26.485509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764a93-7bea-48ef-8aef-87e0771fec0e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:26.485998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764a93-7bea-48ef-8aef-87e0771fec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:26.521317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-24764a93-7bea-48ef-8aef-87e0771fec0e None None] MFA Rules not processed for user `c8d14796ae864b15821f4b40f78e531d`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:26.522571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-24764a93-7bea-48ef-8aef-87e0771fec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:26.599592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1100/2175] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:26.600453 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39084bd-1a8e-495c-b036-50646169db48 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:26.609674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f39084bd-1a8e-495c-b036-50646169db48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:26.614355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24764a93-7bea-48ef-8aef-87e0771fec0e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:26.615818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-24764a93-7bea-48ef-8aef-87e0771fec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:26.706584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39084bd-1a8e-495c-b036-50646169db48 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:26.713968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:26.715967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:26.716345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:26.717625 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] PATH_INFO: `/v3/users/1d4eb494fd8c446895505b0ae6b6f343` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:26.719501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d4eb494fd8c446895505b0ae6b6f343)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:26.722903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:26.729143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24764a93-7bea-48ef-8aef-87e0771fec0e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:26.742730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddb91f-e619-44f2-9b7b-03dba0a1d1e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:26.746188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddb91f-e619-44f2-9b7b-03dba0a1d1e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:26.746188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddb91f-e619-44f2-9b7b-03dba0a1d1e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:26.746188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddb91f-e619-44f2-9b7b-03dba0a1d1e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:26.756306 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddb91f-e619-44f2-9b7b-03dba0a1d1e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:26.758241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddb91f-e619-44f2-9b7b-03dba0a1d1e8 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:26.769637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1101/2176] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:44:26.808065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d4eb494fd8c446895505b0ae6b6f343'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:26.809610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d4eb494fd8c446895505b0ae6b6f343'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:26.811705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d4eb494fd8c446895505b0ae6b6f343'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:26.833619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d4eb494fd8c446895505b0ae6b6f343'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:26.851215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d4eb494fd8c446895505b0ae6b6f343'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:26.882352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1076/2177] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:26 2022] DELETE /identity/v3/users/1d4eb494fd8c446895505b0ae6b6f343 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:26.886914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35dcb-60b4-4ad2-acca-19b5ef3039bc None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:26.887222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35dcb-60b4-4ad2-acca-19b5ef3039bc None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:26.887512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b35dcb-60b4-4ad2-acca-19b5ef3039bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:26.920802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-88b35dcb-60b4-4ad2-acca-19b5ef3039bc None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:26.922241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-88b35dcb-60b4-4ad2-acca-19b5ef3039bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:27.033773 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1102/2178] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:44:27.048046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:27.050455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:27.183295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9585ccf-363b-43aa-941a-ded6d94003ce admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:27.190703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c9c83-9403-4106-ab4c-efeb7f0d510c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:27.192602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c9c83-9403-4106-ab4c-efeb7f0d510c service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.193104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c9c83-9403-4106-ab4c-efeb7f0d510c service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.193609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c9c83-9403-4106-ab4c-efeb7f0d510c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.207720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c9c83-9403-4106-ab4c-efeb7f0d510c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:27.210674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c9c83-9403-4106-ab4c-efeb7f0d510c service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:27.220515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:27.239776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1077/2179] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:27.591740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35dcb-60b4-4ad2-acca-19b5ef3039bc None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:27.594140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-88b35dcb-60b4-4ad2-acca-19b5ef3039bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:27.614848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b35dcb-60b4-4ad2-acca-19b5ef3039bc None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:27.621687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:27.622656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.624084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.624430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] PATH_INFO: `/v3/projects/61f778f62ed9422eb258c8b40ef020a0` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.625948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f778f62ed9422eb258c8b40ef020a0)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:27.632788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:27.644483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:27.694882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f778f62ed9422eb258c8b40ef020a0', 'request_id': 'req-74d78a71-cc3c-4872-ac92-b0e8421e4f43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:27.708146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f778f62ed9422eb258c8b40ef020a0', 'request_id': 'req-74d78a71-cc3c-4872-ac92-b0e8421e4f43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:27.731488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f778f62ed9422eb258c8b40ef020a0', 'request_id': 'req-74d78a71-cc3c-4872-ac92-b0e8421e4f43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:27.749729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] The token cache is being invalidate because project 61f778f62ed9422eb258c8b40ef020a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:27.750021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:27.750745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-74d78a71-cc3c-4872-ac92-b0e8421e4f43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:27.752341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1103/2180] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:27 2022] DELETE /identity/v3/projects/61f778f62ed9422eb258c8b40ef020a0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:27.758348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fc834-a987-418a-bc62-b37e9a9a5a1c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.758908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fc834-a987-418a-bc62-b37e9a9a5a1c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.758908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2fc834-a987-418a-bc62-b37e9a9a5a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.803562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-5c2fc834-a987-418a-bc62-b37e9a9a5a1c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:27.804865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5c2fc834-a987-418a-bc62-b37e9a9a5a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:27.880381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1078/2181] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:27.889750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317749f2-4eab-4ff5-af4d-4b03eabcc498 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.890039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317749f2-4eab-4ff5-af4d-4b03eabcc498 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.890352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317749f2-4eab-4ff5-af4d-4b03eabcc498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.911239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-317749f2-4eab-4ff5-af4d-4b03eabcc498 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:27.913311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-317749f2-4eab-4ff5-af4d-4b03eabcc498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:27.930994 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1104/2182] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:27.932500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fc834-a987-418a-bc62-b37e9a9a5a1c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:27.945599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2fc834-a987-418a-bc62-b37e9a9a5a1c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:27.950955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f004b-7588-42b7-92e5-1eb412c8e28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:27.952134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f004b-7588-42b7-92e5-1eb412c8e28b admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:27.952429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f004b-7588-42b7-92e5-1eb412c8e28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:27.952692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f004b-7588-42b7-92e5-1eb412c8e28b admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:27.953456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f004b-7588-42b7-92e5-1eb412c8e28b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:27.953774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f004b-7588-42b7-92e5-1eb412c8e28b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:27.955442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f004b-7588-42b7-92e5-1eb412c8e28b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:27.978414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1079/2183] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:44:27.983913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317749f2-4eab-4ff5-af4d-4b03eabcc498 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:27.994683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317749f2-4eab-4ff5-af4d-4b03eabcc498 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:28.000369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682937-2ca2-4d38-b625-ccdf8e1c4ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:28.001551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682937-2ca2-4d38-b625-ccdf8e1c4ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:28.002120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682937-2ca2-4d38-b625-ccdf8e1c4ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:28.002615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12682937-2ca2-4d38-b625-ccdf8e1c4ee0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:28.003672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12682937-2ca2-4d38-b625-ccdf8e1c4ee0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:28.005851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12682937-2ca2-4d38-b625-ccdf8e1c4ee0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:28.045984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1105/2184] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:27 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:44:28.052127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f004b-7588-42b7-92e5-1eb412c8e28b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:28.069976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f004b-7588-42b7-92e5-1eb412c8e28b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:28.155422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a99968-3acd-43f0-8540-17318096c251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:28.156112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a99968-3acd-43f0-8540-17318096c251 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:28.156399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a99968-3acd-43f0-8540-17318096c251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:28.156712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a99968-3acd-43f0-8540-17318096c251 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:28.157462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a99968-3acd-43f0-8540-17318096c251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:28.159632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a99968-3acd-43f0-8540-17318096c251 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:28.194252 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1080/2185] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:28 2022] POST /identity/v3/users => generated 284 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:28.195779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682937-2ca2-4d38-b625-ccdf8e1c4ee0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:28.208696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12682937-2ca2-4d38-b625-ccdf8e1c4ee0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:28.213721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca75910-2066-4c73-b948-4f3a70ab0948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:28.214491 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca75910-2066-4c73-b948-4f3a70ab0948 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:28.214938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca75910-2066-4c73-b948-4f3a70ab0948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:28.215288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca75910-2066-4c73-b948-4f3a70ab0948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:28.216111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca75910-2066-4c73-b948-4f3a70ab0948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:28.218637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca75910-2066-4c73-b948-4f3a70ab0948 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:28.235571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1106/2186] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:28.243001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a99968-3acd-43f0-8540-17318096c251 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:28.256067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a99968-3acd-43f0-8540-17318096c251 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:28.261436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16814207-b728-48a7-a51c-4803b8198dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:28.262238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814207-b728-48a7-a51c-4803b8198dae admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:28.262531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814207-b728-48a7-a51c-4803b8198dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:28.262939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16814207-b728-48a7-a51c-4803b8198dae admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:28.263778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16814207-b728-48a7-a51c-4803b8198dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:28.265566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16814207-b728-48a7-a51c-4803b8198dae admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:28.277348 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1081/2187] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:28.282065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca75910-2066-4c73-b948-4f3a70ab0948 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:28.293508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca75910-2066-4c73-b948-4f3a70ab0948 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:28.308821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c3ba3-d50c-475c-b831-f58be49b9949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:28.310010 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3ba3-d50c-475c-b831-f58be49b9949 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:28.310804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3ba3-d50c-475c-b831-f58be49b9949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:28.312392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c3ba3-d50c-475c-b831-f58be49b9949 admin admin] PATH_INFO: `/v3/projects/c0cb6ba4b0d14fc983248286a9d1c47f/users/d516609aab064042a0f2039ab46ff59e/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:28.332396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c3ba3-d50c-475c-b831-f58be49b9949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0cb6ba4b0d14fc983248286a9d1c47f, user_id=d516609aab064042a0f2039ab46ff59e, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:28.335326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c3ba3-d50c-475c-b831-f58be49b9949 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:28.349695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1107/2188] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:28 2022] PUT /identity/v3/projects/c0cb6ba4b0d14fc983248286a9d1c47f/users/d516609aab064042a0f2039ab46ff59e/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:28.361748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f32f9-1938-4538-a7b5-02f66e5353dc None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:28.362041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f32f9-1938-4538-a7b5-02f66e5353dc None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:28.362381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904f32f9-1938-4538-a7b5-02f66e5353dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:28.393825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-904f32f9-1938-4538-a7b5-02f66e5353dc None None] MFA Rules not processed for user `d516609aab064042a0f2039ab46ff59e`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:28.395190 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-904f32f9-1938-4538-a7b5-02f66e5353dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:28.448578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:28.491667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1082/2189] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:28.506508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c3ba3-d50c-475c-b831-f58be49b9949 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:28.508888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6e3c3ba3-d50c-475c-b831-f58be49b9949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:28.573662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c3ba3-d50c-475c-b831-f58be49b9949 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:28.577400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8abae-bfd8-4ee2-be30-297a684e64d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:28.578052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8abae-bfd8-4ee2-be30-297a684e64d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:28.578359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8abae-bfd8-4ee2-be30-297a684e64d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:28.578635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8abae-bfd8-4ee2-be30-297a684e64d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:28.587728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8abae-bfd8-4ee2-be30-297a684e64d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:28.589296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8abae-bfd8-4ee2-be30-297a684e64d3 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:28.599812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1108/2190] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:28 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:28.627647 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f32f9-1938-4538-a7b5-02f66e5353dc None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:28.691513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904f32f9-1938-4538-a7b5-02f66e5353dc None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:28.696188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:28.697060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:28.697412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:28.697628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] PATH_INFO: `/v3/users/d516609aab064042a0f2039ab46ff59e` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:28.698892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d516609aab064042a0f2039ab46ff59e)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:28.700845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:28.752797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd516609aab064042a0f2039ab46ff59e'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:28.753453 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd516609aab064042a0f2039ab46ff59e'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:28.754061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd516609aab064042a0f2039ab46ff59e'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:28.768922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd516609aab064042a0f2039ab46ff59e'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:28.778028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd516609aab064042a0f2039ab46ff59e'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:28.797774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1083/2191] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:28 2022] DELETE /identity/v3/users/d516609aab064042a0f2039ab46ff59e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:28.802382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c131f-dd56-4d60-9df9-c96cbf26f094 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:28.802704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c131f-dd56-4d60-9df9-c96cbf26f094 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:28.802989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c131f-dd56-4d60-9df9-c96cbf26f094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:28.824453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-730c131f-dd56-4d60-9df9-c96cbf26f094 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:28.825682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-730c131f-dd56-4d60-9df9-c96cbf26f094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:28.867013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:28.911016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1109/2192] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:28.921486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:28.923023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:28.986373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b5bb-4887-4e71-ae62-c6ea9ffd9ef7 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:28.989979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8753e684-4225-401f-b3ec-77dacd58efda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:28.990655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753e684-4225-401f-b3ec-77dacd58efda service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:28.990940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753e684-4225-401f-b3ec-77dacd58efda service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:28.991215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8753e684-4225-401f-b3ec-77dacd58efda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:29.001296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753e684-4225-401f-b3ec-77dacd58efda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:29.002780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8753e684-4225-401f-b3ec-77dacd58efda service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:29.013829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1084/2193] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:29.410579 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c131f-dd56-4d60-9df9-c96cbf26f094 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:29.412089 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-730c131f-dd56-4d60-9df9-c96cbf26f094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:29.425291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c131f-dd56-4d60-9df9-c96cbf26f094 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:29.430064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:29.430988 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:29.431267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:29.431570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] PATH_INFO: `/v3/projects/c0cb6ba4b0d14fc983248286a9d1c47f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:29.432782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0cb6ba4b0d14fc983248286a9d1c47f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:29.434852 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:29.502811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0cb6ba4b0d14fc983248286a9d1c47f', 'request_id': 'req-bea70793-81e4-473a-89a0-eb34dbf33d2e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:29.518495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0cb6ba4b0d14fc983248286a9d1c47f', 'request_id': 'req-bea70793-81e4-473a-89a0-eb34dbf33d2e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:29.526329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0cb6ba4b0d14fc983248286a9d1c47f', 'request_id': 'req-bea70793-81e4-473a-89a0-eb34dbf33d2e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:29.545382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] The token cache is being invalidate because project c0cb6ba4b0d14fc983248286a9d1c47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:29.545680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:29.546448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea70793-81e4-473a-89a0-eb34dbf33d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:29.548857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1110/2194] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:29 2022] DELETE /identity/v3/projects/c0cb6ba4b0d14fc983248286a9d1c47f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:29.555151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479dccf-3380-4197-8aec-ea5ecef8e398 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:29.555661 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479dccf-3380-4197-8aec-ea5ecef8e398 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:29.556262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479dccf-3380-4197-8aec-ea5ecef8e398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:29.564301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:29.585175 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-4479dccf-3380-4197-8aec-ea5ecef8e398 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:29.588304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4479dccf-3380-4197-8aec-ea5ecef8e398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:29.672270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1085/2195] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:29.681193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706fbe1-493f-4d35-a661-6f0cfd6374ad None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:29.682140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706fbe1-493f-4d35-a661-6f0cfd6374ad None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:29.682420 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706fbe1-493f-4d35-a661-6f0cfd6374ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:29.708213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1706fbe1-493f-4d35-a661-6f0cfd6374ad None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:29.709654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1706fbe1-493f-4d35-a661-6f0cfd6374ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:29.723215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1111/2196] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:29.735853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479dccf-3380-4197-8aec-ea5ecef8e398 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:29.747235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479dccf-3380-4197-8aec-ea5ecef8e398 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:29.754512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33678f72-0709-4dad-b485-61d27abd1559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:29.755493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33678f72-0709-4dad-b485-61d27abd1559 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:29.755776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33678f72-0709-4dad-b485-61d27abd1559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:29.756058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33678f72-0709-4dad-b485-61d27abd1559 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:29.757067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33678f72-0709-4dad-b485-61d27abd1559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:29.757459 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33678f72-0709-4dad-b485-61d27abd1559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:29.759338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33678f72-0709-4dad-b485-61d27abd1559 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:29.773759 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1086/2197] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:29.777029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706fbe1-493f-4d35-a661-6f0cfd6374ad None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:29.786709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706fbe1-493f-4d35-a661-6f0cfd6374ad None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:29.792154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8105d8-47a7-4333-ac0a-1a5d0179c137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:29.792818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8105d8-47a7-4333-ac0a-1a5d0179c137 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:29.793105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8105d8-47a7-4333-ac0a-1a5d0179c137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:29.793383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8105d8-47a7-4333-ac0a-1a5d0179c137 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:29.794096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8105d8-47a7-4333-ac0a-1a5d0179c137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:29.796537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8105d8-47a7-4333-ac0a-1a5d0179c137 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:29.828887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1112/2198] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:29 2022] POST /identity/v3/projects => generated 395 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:29.830688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33678f72-0709-4dad-b485-61d27abd1559 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:29.841126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33678f72-0709-4dad-b485-61d27abd1559 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:29.906409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b51bd-b305-4fc9-a929-06ab186baf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:29.907068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b51bd-b305-4fc9-a929-06ab186baf65 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:29.907350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b51bd-b305-4fc9-a929-06ab186baf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:29.907627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b51bd-b305-4fc9-a929-06ab186baf65 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:29.908488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b51bd-b305-4fc9-a929-06ab186baf65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:29.910733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b51bd-b305-4fc9-a929-06ab186baf65 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:29.939297 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1087/2199] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:29 2022] POST /identity/v3/users => generated 298 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:29.945393 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8105d8-47a7-4333-ac0a-1a5d0179c137 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:29.963967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8105d8-47a7-4333-ac0a-1a5d0179c137 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:29.972034 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da44ae4-b6da-4784-a358-079b99a6cce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:29.972836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da44ae4-b6da-4784-a358-079b99a6cce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:29.973326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da44ae4-b6da-4784-a358-079b99a6cce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:29.973790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da44ae4-b6da-4784-a358-079b99a6cce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:29.975081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da44ae4-b6da-4784-a358-079b99a6cce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:29.988744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da44ae4-b6da-4784-a358-079b99a6cce2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:30.012065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1113/2200] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:30.018265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b51bd-b305-4fc9-a929-06ab186baf65 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:30.030648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b51bd-b305-4fc9-a929-06ab186baf65 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:30.036457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4476e5-4ab4-4127-a8c1-6cdedb6350db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:30.037560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4476e5-4ab4-4127-a8c1-6cdedb6350db admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:30.037860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4476e5-4ab4-4127-a8c1-6cdedb6350db admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:30.038169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4476e5-4ab4-4127-a8c1-6cdedb6350db admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:30.038991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4476e5-4ab4-4127-a8c1-6cdedb6350db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:30.041038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4476e5-4ab4-4127-a8c1-6cdedb6350db admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:30.055781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1088/2201] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:30.062068 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da44ae4-b6da-4784-a358-079b99a6cce2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:30.074107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da44ae4-b6da-4784-a358-079b99a6cce2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:30.080026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622a49-a3c8-420b-971d-ef0d48825569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:30.080711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622a49-a3c8-420b-971d-ef0d48825569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:30.081145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622a49-a3c8-420b-971d-ef0d48825569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:30.081710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622a49-a3c8-420b-971d-ef0d48825569 admin admin] PATH_INFO: `/v3/projects/4ca307eeb39d4b6289bcac31fbc12d47/users/0a8f0300fec04a8698e03c280dbf2436/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:30.101281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef622a49-a3c8-420b-971d-ef0d48825569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca307eeb39d4b6289bcac31fbc12d47, user_id=0a8f0300fec04a8698e03c280dbf2436, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:30.105879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef622a49-a3c8-420b-971d-ef0d48825569 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:30.122162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1114/2202] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:30 2022] PUT /identity/v3/projects/4ca307eeb39d4b6289bcac31fbc12d47/users/0a8f0300fec04a8698e03c280dbf2436/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:30.132803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d856ef-2768-489f-b438-e67e967a80a6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:30.133100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d856ef-2768-489f-b438-e67e967a80a6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:30.133386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d856ef-2768-489f-b438-e67e967a80a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:30.170558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-05d856ef-2768-489f-b438-e67e967a80a6 None None] MFA Rules not processed for user `0a8f0300fec04a8698e03c280dbf2436`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:30.172461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-05d856ef-2768-489f-b438-e67e967a80a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:30.242569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:30.252445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1089/2203] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:30.265646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622a49-a3c8-420b-971d-ef0d48825569 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:30.267448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ef622a49-a3c8-420b-971d-ef0d48825569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:30.328765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622a49-a3c8-420b-971d-ef0d48825569 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:30.332401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ad4d4-9232-4a17-a2b6-6356722e4bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:30.333190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ad4d4-9232-4a17-a2b6-6356722e4bfe service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:30.333471 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ad4d4-9232-4a17-a2b6-6356722e4bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:30.333740 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ad4d4-9232-4a17-a2b6-6356722e4bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:30.340115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:30.343637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ad4d4-9232-4a17-a2b6-6356722e4bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:30.346464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934ad4d4-9232-4a17-a2b6-6356722e4bfe service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:30.357297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1115/2204] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:35.378982 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d856ef-2768-489f-b438-e67e967a80a6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:35.448618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d856ef-2768-489f-b438-e67e967a80a6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:35.453980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:35.454896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:35.455181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:35.455454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] PATH_INFO: `/v3/users/0a8f0300fec04a8698e03c280dbf2436` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:35.456685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8f0300fec04a8698e03c280dbf2436)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:35.458690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:35.514437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8f0300fec04a8698e03c280dbf2436'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:35.515014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8f0300fec04a8698e03c280dbf2436'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:35.515616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8f0300fec04a8698e03c280dbf2436'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:35.529472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8f0300fec04a8698e03c280dbf2436'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:35.536824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8f0300fec04a8698e03c280dbf2436'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:35.551734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1090/2205] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:35 2022] DELETE /identity/v3/users/0a8f0300fec04a8698e03c280dbf2436 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:35.558442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c19fd5-5f97-412e-8fe2-d8a874f7670c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:35.559272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c19fd5-5f97-412e-8fe2-d8a874f7670c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:35.559272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c19fd5-5f97-412e-8fe2-d8a874f7670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:35.576665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-81c19fd5-5f97-412e-8fe2-d8a874f7670c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:35.577866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-81c19fd5-5f97-412e-8fe2-d8a874f7670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:35.648469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1116/2206] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:35.659641 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:35.660596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:35.725766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d2cc6-cf44-4e25-8db4-43531e214667 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:35.729473 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8158cd5-ba39-4c04-8347-a9cf2f2b1575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:35.730153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158cd5-ba39-4c04-8347-a9cf2f2b1575 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:35.730436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158cd5-ba39-4c04-8347-a9cf2f2b1575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:35.730707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8158cd5-ba39-4c04-8347-a9cf2f2b1575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:35.741823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8158cd5-ba39-4c04-8347-a9cf2f2b1575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:35.743294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8158cd5-ba39-4c04-8347-a9cf2f2b1575 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:35.753682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1091/2207] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:36.058495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c19fd5-5f97-412e-8fe2-d8a874f7670c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.060167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-81c19fd5-5f97-412e-8fe2-d8a874f7670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:36.078847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c19fd5-5f97-412e-8fe2-d8a874f7670c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.083959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.084834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.085115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.085386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] PATH_INFO: `/v3/projects/4ca307eeb39d4b6289bcac31fbc12d47` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.086626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca307eeb39d4b6289bcac31fbc12d47)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.090016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.145466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca307eeb39d4b6289bcac31fbc12d47', 'request_id': 'req-26abaf5c-9114-41ba-8b2b-8d4135183e57'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:36.153002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca307eeb39d4b6289bcac31fbc12d47', 'request_id': 'req-26abaf5c-9114-41ba-8b2b-8d4135183e57'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:36.161457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca307eeb39d4b6289bcac31fbc12d47', 'request_id': 'req-26abaf5c-9114-41ba-8b2b-8d4135183e57'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:36.174417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] The token cache is being invalidate because project 4ca307eeb39d4b6289bcac31fbc12d47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:36.174764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:36.175472 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-26abaf5c-9114-41ba-8b2b-8d4135183e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:36.177378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1117/2208] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:36 2022] DELETE /identity/v3/projects/4ca307eeb39d4b6289bcac31fbc12d47 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:36.182720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644095-eca7-4da4-b671-3e1abd1913e4 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.183007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644095-eca7-4da4-b671-3e1abd1913e4 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.183286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644095-eca7-4da4-b671-3e1abd1913e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.204483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-fc644095-eca7-4da4-b671-3e1abd1913e4 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:36.205755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fc644095-eca7-4da4-b671-3e1abd1913e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:36.221431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:36.276971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1092/2209] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:36.286221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf4e55-102e-4c23-a85f-78d9a7bb07f4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.286532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf4e55-102e-4c23-a85f-78d9a7bb07f4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.286813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf4e55-102e-4c23-a85f-78d9a7bb07f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.305734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-58cf4e55-102e-4c23-a85f-78d9a7bb07f4 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:36.307101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-58cf4e55-102e-4c23-a85f-78d9a7bb07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:36.315863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1118/2210] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:36.320660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644095-eca7-4da4-b671-3e1abd1913e4 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.331109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644095-eca7-4da4-b671-3e1abd1913e4 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.335725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b091e5-5ea2-4be9-9059-9303fd1c9bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.336385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b091e5-5ea2-4be9-9059-9303fd1c9bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.336671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b091e5-5ea2-4be9-9059-9303fd1c9bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.336945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b091e5-5ea2-4be9-9059-9303fd1c9bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.337896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b091e5-5ea2-4be9-9059-9303fd1c9bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:44:36.338221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b091e5-5ea2-4be9-9059-9303fd1c9bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.339833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b091e5-5ea2-4be9-9059-9303fd1c9bf2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.351791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1093/2211] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:44:36.356350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf4e55-102e-4c23-a85f-78d9a7bb07f4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.367707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf4e55-102e-4c23-a85f-78d9a7bb07f4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.375095 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbecce-78a0-4ecf-a498-8694fb79717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.375894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbecce-78a0-4ecf-a498-8694fb79717d admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.376215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbecce-78a0-4ecf-a498-8694fb79717d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.376630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbecce-78a0-4ecf-a498-8694fb79717d admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.377385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbecce-78a0-4ecf-a498-8694fb79717d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.379590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbecce-78a0-4ecf-a498-8694fb79717d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.410189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1119/2212] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:36 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:36.415129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b091e5-5ea2-4be9-9059-9303fd1c9bf2 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.426573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b091e5-5ea2-4be9-9059-9303fd1c9bf2 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.499700 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f864ae-fff3-418b-967f-edd8b6a464f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.500403 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f864ae-fff3-418b-967f-edd8b6a464f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.500691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f864ae-fff3-418b-967f-edd8b6a464f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.500971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f864ae-fff3-418b-967f-edd8b6a464f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.501706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f864ae-fff3-418b-967f-edd8b6a464f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.503733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f864ae-fff3-418b-967f-edd8b6a464f9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.532317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1094/2213] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:36 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:36.536523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbecce-78a0-4ecf-a498-8694fb79717d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.551870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbecce-78a0-4ecf-a498-8694fb79717d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.558378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a9c0-1226-497c-aa9d-41f83a2b9b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.558946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a9c0-1226-497c-aa9d-41f83a2b9b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.559647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a9c0-1226-497c-aa9d-41f83a2b9b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.559647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a9c0-1226-497c-aa9d-41f83a2b9b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.560909 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141a9c0-1226-497c-aa9d-41f83a2b9b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.562578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141a9c0-1226-497c-aa9d-41f83a2b9b46 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.593644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1120/2214] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:36.597670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f864ae-fff3-418b-967f-edd8b6a464f9 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.610170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f864ae-fff3-418b-967f-edd8b6a464f9 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.617153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ccea8-d439-45a2-95a7-b44ca82fa645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.618179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccea8-d439-45a2-95a7-b44ca82fa645 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.618462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccea8-d439-45a2-95a7-b44ca82fa645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.618734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ccea8-d439-45a2-95a7-b44ca82fa645 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.619687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ccea8-d439-45a2-95a7-b44ca82fa645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.621461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ccea8-d439-45a2-95a7-b44ca82fa645 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.637865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1095/2215] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:36.642263 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a9c0-1226-497c-aa9d-41f83a2b9b46 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.654114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a9c0-1226-497c-aa9d-41f83a2b9b46 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.659626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f5e0c-025d-4960-9d3d-c410e1e8fef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.660581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f5e0c-025d-4960-9d3d-c410e1e8fef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.661012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f5e0c-025d-4960-9d3d-c410e1e8fef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.661296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554f5e0c-025d-4960-9d3d-c410e1e8fef0 admin admin] PATH_INFO: `/v3/projects/06668eb815d84458a0ed875b89b26e3d/users/f1858187cb754bbe80bc36713e715d6c/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.678686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f5e0c-025d-4960-9d3d-c410e1e8fef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06668eb815d84458a0ed875b89b26e3d, user_id=f1858187cb754bbe80bc36713e715d6c, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.681381 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554f5e0c-025d-4960-9d3d-c410e1e8fef0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.696926 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1121/2216] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:36 2022] PUT /identity/v3/projects/06668eb815d84458a0ed875b89b26e3d/users/f1858187cb754bbe80bc36713e715d6c/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:36.703314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e3970-d120-45c9-862e-b91d217a9087 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.703937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e3970-d120-45c9-862e-b91d217a9087 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.704269 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e3970-d120-45c9-862e-b91d217a9087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.735343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1b8e3970-d120-45c9-862e-b91d217a9087 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:36.736726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1b8e3970-d120-45c9-862e-b91d217a9087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:36.816157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1096/2217] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:36.827549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f5e0c-025d-4960-9d3d-c410e1e8fef0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:36.829722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-554f5e0c-025d-4960-9d3d-c410e1e8fef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:36.868204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:36.924934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554f5e0c-025d-4960-9d3d-c410e1e8fef0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:36.929208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7856afb2-1949-4b14-b5e4-3cb201cfa266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:36.929873 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856afb2-1949-4b14-b5e4-3cb201cfa266 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:36.930192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856afb2-1949-4b14-b5e4-3cb201cfa266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:36.930470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7856afb2-1949-4b14-b5e4-3cb201cfa266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:36.942486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856afb2-1949-4b14-b5e4-3cb201cfa266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:36.944697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7856afb2-1949-4b14-b5e4-3cb201cfa266 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:36.957753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1122/2218] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:37.116275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e3970-d120-45c9-862e-b91d217a9087 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:37.119437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1b8e3970-d120-45c9-862e-b91d217a9087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:37.139866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e3970-d120-45c9-862e-b91d217a9087 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:37.148685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:37.150073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:37.150484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:37.150885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] PATH_INFO: `/v3/users/c8d14796ae864b15821f4b40f78e531d` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:37.152565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8d14796ae864b15821f4b40f78e531d)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:37.155508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:37.188090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:37.241001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8d14796ae864b15821f4b40f78e531d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:37.242214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8d14796ae864b15821f4b40f78e531d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:37.245298 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8d14796ae864b15821f4b40f78e531d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:37.262009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8d14796ae864b15821f4b40f78e531d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:37.272471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8d14796ae864b15821f4b40f78e531d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:37.291307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1097/2219] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:44:37 2022] DELETE /identity/v3/users/c8d14796ae864b15821f4b40f78e531d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:37.297357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84a4ba-0161-4fd1-b2d6-fb493d99e623 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:37.298037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84a4ba-0161-4fd1-b2d6-fb493d99e623 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:37.298754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84a4ba-0161-4fd1-b2d6-fb493d99e623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:37.330966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-fa84a4ba-0161-4fd1-b2d6-fb493d99e623 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:37.332214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fa84a4ba-0161-4fd1-b2d6-fb493d99e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:37.422390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1123/2220] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:37.435686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:37.437411 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:37.514316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86de7ea-172b-4ecb-9308-c5e598d29977 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:37.518448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9c0ed-dfcd-40ed-8d01-c8264d7ee9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:37.519108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c0ed-dfcd-40ed-8d01-c8264d7ee9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:37.519388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c0ed-dfcd-40ed-8d01-c8264d7ee9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:37.519719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9c0ed-dfcd-40ed-8d01-c8264d7ee9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:37.531792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9c0ed-dfcd-40ed-8d01-c8264d7ee9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:37.533249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9c0ed-dfcd-40ed-8d01-c8264d7ee9d6 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:37.548316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1098/2221] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:38.139563 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84a4ba-0161-4fd1-b2d6-fb493d99e623 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:38.144416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fa84a4ba-0161-4fd1-b2d6-fb493d99e623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:38.169101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84a4ba-0161-4fd1-b2d6-fb493d99e623 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:38.180772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:38.181667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:38.181946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:38.182261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] PATH_INFO: `/v3/projects/ca6e26136eaf4e3eac9014e5791053f6` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:38.184053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6e26136eaf4e3eac9014e5791053f6)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:38.187069 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:38.283675 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6e26136eaf4e3eac9014e5791053f6', 'request_id': 'req-fc1d8754-80a4-45d9-a86d-c518897e5158'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:38.298413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6e26136eaf4e3eac9014e5791053f6', 'request_id': 'req-fc1d8754-80a4-45d9-a86d-c518897e5158'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:38.308676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6e26136eaf4e3eac9014e5791053f6', 'request_id': 'req-fc1d8754-80a4-45d9-a86d-c518897e5158'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:38.326755 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] The token cache is being invalidate because project ca6e26136eaf4e3eac9014e5791053f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:44:38.327383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:38.329288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:44:38.344541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1124/2222] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:44:38 2022] DELETE /identity/v3/projects/ca6e26136eaf4e3eac9014e5791053f6 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:40.257565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c228-1b9d-4a85-a723-2cb2f0ec54c8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:40.258268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c228-1b9d-4a85-a723-2cb2f0ec54c8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:40.258592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8c228-1b9d-4a85-a723-2cb2f0ec54c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:40.321230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-67c8c228-1b9d-4a85-a723-2cb2f0ec54c8 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:40.324120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-67c8c228-1b9d-4a85-a723-2cb2f0ec54c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:40.444886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1099/2223] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:40.466870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:40.469201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:40.596713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:40.671848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d8754-80a4-45d9-a86d-c518897e5158 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:40.689741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a730a-1b21-495c-a080-a8a6da172604 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:40.690892 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a730a-1b21-495c-a080-a8a6da172604 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:40.692066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a730a-1b21-495c-a080-a8a6da172604 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:40.692654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a730a-1b21-495c-a080-a8a6da172604 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:40.704717 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a730a-1b21-495c-a080-a8a6da172604 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:40.707691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a730a-1b21-495c-a080-a8a6da172604 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:40.723993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1125/2224] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:44:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:44:44.483461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a88358-086f-475f-bcf5-2a680c6b54de None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:44.484434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a88358-086f-475f-bcf5-2a680c6b54de None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:44.484938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a88358-086f-475f-bcf5-2a680c6b54de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:44.547111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-90a88358-086f-475f-bcf5-2a680c6b54de None None] MFA Rules not processed for user `f1858187cb754bbe80bc36713e715d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:44.551249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-90a88358-086f-475f-bcf5-2a680c6b54de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:44.612635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:44.694217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1100/2225] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:44.697324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a730a-1b21-495c-a080-a8a6da172604 service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:44.699934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-474a730a-1b21-495c-a080-a8a6da172604 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:44.796651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a730a-1b21-495c-a080-a8a6da172604 service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:44.802204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb0120-dc32-4587-9ed0-1f8c5846739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:44.803060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb0120-dc32-4587-9ed0-1f8c5846739e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:44.803471 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb0120-dc32-4587-9ed0-1f8c5846739e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:44.803830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb0120-dc32-4587-9ed0-1f8c5846739e admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:44.804618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb0120-dc32-4587-9ed0-1f8c5846739e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:44.806741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb0120-dc32-4587-9ed0-1f8c5846739e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:44.846159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a88358-086f-475f-bcf5-2a680c6b54de None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:44.848895 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1126/2226] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:44:44 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:44.868682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a88358-086f-475f-bcf5-2a680c6b54de None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:45.051760 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80119-1788-43e0-9cef-99f8f006d0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:45.052470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80119-1788-43e0-9cef-99f8f006d0ff admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:45.052753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80119-1788-43e0-9cef-99f8f006d0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:45.053027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e80119-1788-43e0-9cef-99f8f006d0ff admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:45.054228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e80119-1788-43e0-9cef-99f8f006d0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:45.057904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e80119-1788-43e0-9cef-99f8f006d0ff admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:45.106482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb0120-dc32-4587-9ed0-1f8c5846739e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:45.126163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1101/2227] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:44:44 2022] POST /identity/v3/users => generated 299 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:44:45.161668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb0120-dc32-4587-9ed0-1f8c5846739e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:45.173580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ccf63-5877-4bb3-bf8a-6b76d2ecaffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:45.175078 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ccf63-5877-4bb3-bf8a-6b76d2ecaffc admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:45.175607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ccf63-5877-4bb3-bf8a-6b76d2ecaffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:45.176633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ccf63-5877-4bb3-bf8a-6b76d2ecaffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:45.178024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ccf63-5877-4bb3-bf8a-6b76d2ecaffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:45.179977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ccf63-5877-4bb3-bf8a-6b76d2ecaffc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:45.205318 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1127/2228] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:44:45.213170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80119-1788-43e0-9cef-99f8f006d0ff admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:45.248612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e80119-1788-43e0-9cef-99f8f006d0ff admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:45.269843 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ef3a0-0227-4abc-aca9-83672b4531ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:45.271914 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ef3a0-0227-4abc-aca9-83672b4531ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:45.272407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ef3a0-0227-4abc-aca9-83672b4531ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:45.273109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ef3a0-0227-4abc-aca9-83672b4531ef admin admin] PATH_INFO: `/v3/projects/504df3b50c7240e7bc0e10fc6282e6ab/users/bfa3f02a73c7458db84eaf34d1d6c7de/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:45.322104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ef3a0-0227-4abc-aca9-83672b4531ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=504df3b50c7240e7bc0e10fc6282e6ab, user_id=bfa3f02a73c7458db84eaf34d1d6c7de, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:45.334638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ef3a0-0227-4abc-aca9-83672b4531ef admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:45.374128 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1102/2229] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:45 2022] PUT /identity/v3/projects/504df3b50c7240e7bc0e10fc6282e6ab/users/bfa3f02a73c7458db84eaf34d1d6c7de/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:44:45.376141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ccf63-5877-4bb3-bf8a-6b76d2ecaffc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:45.404333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ccf63-5877-4bb3-bf8a-6b76d2ecaffc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:45.666561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac62e8-c897-41f2-afbc-2404f5541192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:45.667637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac62e8-c897-41f2-afbc-2404f5541192 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:45.668076 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac62e8-c897-41f2-afbc-2404f5541192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:45.669661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac62e8-c897-41f2-afbc-2404f5541192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:45.672739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac62e8-c897-41f2-afbc-2404f5541192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:45.674669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac62e8-c897-41f2-afbc-2404f5541192 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:45.693113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1128/2230] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:44:45.693523 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ef3a0-0227-4abc-aca9-83672b4531ef admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:45.718002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ef3a0-0227-4abc-aca9-83672b4531ef admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:45.729830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae338d7-f0a1-4295-aed6-d3a6a521ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:45.731068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae338d7-f0a1-4295-aed6-d3a6a521ae83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:45.736393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae338d7-f0a1-4295-aed6-d3a6a521ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:45.736719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae338d7-f0a1-4295-aed6-d3a6a521ae83 admin admin] PATH_INFO: `/v3/projects/504df3b50c7240e7bc0e10fc6282e6ab/users/bfa3f02a73c7458db84eaf34d1d6c7de/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:45.744768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae338d7-f0a1-4295-aed6-d3a6a521ae83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504df3b50c7240e7bc0e10fc6282e6ab, user_id=bfa3f02a73c7458db84eaf34d1d6c7de, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:45.752850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae338d7-f0a1-4295-aed6-d3a6a521ae83 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:45.774267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1103/2231] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:44:45 2022] PUT /identity/v3/projects/504df3b50c7240e7bc0e10fc6282e6ab/users/bfa3f02a73c7458db84eaf34d1d6c7de/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:44:54.531826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f0b0-b884-4b72-911f-5c890a9226f0 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.533577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f0b0-b884-4b72-911f-5c890a9226f0 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.534303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d11f0b0-b884-4b72-911f-5c890a9226f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.604870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5d11f0b0-b884-4b72-911f-5c890a9226f0 None None] MFA Rules not processed for user `bfa3f02a73c7458db84eaf34d1d6c7de`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:54.607038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5d11f0b0-b884-4b72-911f-5c890a9226f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:54.688804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:54.768677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1129/2232] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:44:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:54.780401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae338d7-f0a1-4295-aed6-d3a6a521ae83 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:54.783824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1ae338d7-f0a1-4295-aed6-d3a6a521ae83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:54.876978 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae338d7-f0a1-4295-aed6-d3a6a521ae83 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:54.881049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4ebf-fd6b-4404-b765-0ad5c2ca3cda service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0edbf66359f1426999f4c28a83f2bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:54.882108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4ebf-fd6b-4404-b765-0ad5c2ca3cda service glance] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:54.882512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4ebf-fd6b-4404-b765-0ad5c2ca3cda service glance] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:54.882905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b4ebf-fd6b-4404-b765-0ad5c2ca3cda service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:54.965129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:44:55.072825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4ebf-fd6b-4404-b765-0ad5c2ca3cda service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:55.074776 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b4ebf-fd6b-4404-b765-0ad5c2ca3cda service glance] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:55.093998 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1104/2233] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:44:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:44:55.264959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d5ba4-48a7-4e65-ae48-2e9eac6fb56b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:55.265254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d5ba4-48a7-4e65-ae48-2e9eac6fb56b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:55.265528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489d5ba4-48a7-4e65-ae48-2e9eac6fb56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:55.291823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-489d5ba4-48a7-4e65-ae48-2e9eac6fb56b None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:44:55.293279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-489d5ba4-48a7-4e65-ae48-2e9eac6fb56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:44:55.446875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1130/2234] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:44:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:44:55.456365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4ebf-fd6b-4404-b765-0ad5c2ca3cda service glance] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:44:55.619751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b4ebf-fd6b-4404-b765-0ad5c2ca3cda service glance] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:44:55.631160 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45627b-ca18-42d3-af3d-8bed709348cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:44:55.632872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45627b-ca18-42d3-af3d-8bed709348cc service swift] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:44:55.633260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45627b-ca18-42d3-af3d-8bed709348cc service swift] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:44:55.633639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45627b-ca18-42d3-af3d-8bed709348cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:44:55.644533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45627b-ca18-42d3-af3d-8bed709348cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:44:55.649344 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45627b-ca18-42d3-af3d-8bed709348cc service swift] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:44:55.664799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1105/2235] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:44:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:45:01.713431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951a41-d6ff-49a8-b23a-b10340e9b4c7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:01.714480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951a41-d6ff-49a8-b23a-b10340e9b4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:01.715106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0951a41-d6ff-49a8-b23a-b10340e9b4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:01.742407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c0951a41-d6ff-49a8-b23a-b10340e9b4c7 None None] MFA Rules not processed for user `4e2fc01480c04ff2988700d0474adebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:01.743858 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c0951a41-d6ff-49a8-b23a-b10340e9b4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:01.842268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1131/2236] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:45:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:45:03.411064 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a55f8-16fc-418e-a800-e3077ee4fdfe None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:03.411648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a55f8-16fc-418e-a800-e3077ee4fdfe None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:03.411648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9a55f8-16fc-418e-a800-e3077ee4fdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:03.530397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-dc9a55f8-16fc-418e-a800-e3077ee4fdfe None None] MFA Rules not processed for user `e26fe8b541484066a2b7c35cd20a4132`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:03.536322 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-dc9a55f8-16fc-418e-a800-e3077ee4fdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:03.640626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1106/2237] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:09.461896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa9a4-d6fc-4268-a213-6285fda189e3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:09.462811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa9a4-d6fc-4268-a213-6285fda189e3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:09.463437 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa9a4-d6fc-4268-a213-6285fda189e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:09.484504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bd9aa9a4-d6fc-4268-a213-6285fda189e3 None None] MFA Rules not processed for user `f1858187cb754bbe80bc36713e715d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:09.486242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bd9aa9a4-d6fc-4268-a213-6285fda189e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:09.498464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1132/2238] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:45:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:09.598864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd27f0a-6ffa-4bfd-8c64-2780c82a7cfa None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:09.598864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd27f0a-6ffa-4bfd-8c64-2780c82a7cfa None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:09.598864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd27f0a-6ffa-4bfd-8c64-2780c82a7cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:09.620533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-0bd27f0a-6ffa-4bfd-8c64-2780c82a7cfa None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:09.621913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0bd27f0a-6ffa-4bfd-8c64-2780c82a7cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:09.629564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1107/2239] 10.222.0.79 () {58 vars in 967 bytes} [Wed May 25 14:45:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:09.648348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa9a4-d6fc-4268-a213-6285fda189e3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:09.666317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa9a4-d6fc-4268-a213-6285fda189e3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:09.674862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e6bb25-77b1-4290-8115-e1791ca3949d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:09.676518 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6bb25-77b1-4290-8115-e1791ca3949d service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:09.677049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6bb25-77b1-4290-8115-e1791ca3949d service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:09.677378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e6bb25-77b1-4290-8115-e1791ca3949d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:09.688405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6bb25-77b1-4290-8115-e1791ca3949d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:09.690811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e6bb25-77b1-4290-8115-e1791ca3949d service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:09.705618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1133/2240] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:45:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:45:12.009888 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd27f0a-6ffa-4bfd-8c64-2780c82a7cfa None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:12.013598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0bd27f0a-6ffa-4bfd-8c64-2780c82a7cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:12.113858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd27f0a-6ffa-4bfd-8c64-2780c82a7cfa None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:12.126536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:12.127939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:12.128309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:12.128756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] PATH_INFO: `/v3/users/f838249fe466445b8390013bad0be94a` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:12.130394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f838249fe466445b8390013bad0be94a)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:12.133039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:12.141753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:12.213719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f838249fe466445b8390013bad0be94a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:12.215063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f838249fe466445b8390013bad0be94a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:12.216063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f838249fe466445b8390013bad0be94a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:12.233583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f838249fe466445b8390013bad0be94a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:12.245506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f838249fe466445b8390013bad0be94a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:12.274120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1108/2241] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:45:12 2022] DELETE /identity/v3/users/f838249fe466445b8390013bad0be94a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:45:12.539594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88880b1-2cbb-43a5-a2ab-3ba2617867f6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:12.540064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88880b1-2cbb-43a5-a2ab-3ba2617867f6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:12.540155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88880b1-2cbb-43a5-a2ab-3ba2617867f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:12.563098 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f88880b1-2cbb-43a5-a2ab-3ba2617867f6 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:12.564334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f88880b1-2cbb-43a5-a2ab-3ba2617867f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:12.644426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:12.662058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1134/2242] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:45:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:12.691800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:12.694588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:12.790853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb4d35-ff6a-452f-b41f-e1cd6c074cb0 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:12.798124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc000a35-cba8-4b02-953d-266175f68283 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:12.798745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc000a35-cba8-4b02-953d-266175f68283 service swift] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:12.799689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc000a35-cba8-4b02-953d-266175f68283 service swift] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:12.799973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc000a35-cba8-4b02-953d-266175f68283 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:12.811120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc000a35-cba8-4b02-953d-266175f68283 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:12.812934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc000a35-cba8-4b02-953d-266175f68283 service swift] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:12.824043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1109/2243] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:45:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:45:12.937951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88880b1-2cbb-43a5-a2ab-3ba2617867f6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:12.939531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f88880b1-2cbb-43a5-a2ab-3ba2617867f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:13.187676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88880b1-2cbb-43a5-a2ab-3ba2617867f6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:13.194953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:13.195843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:13.196131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:13.196407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] PATH_INFO: `/v3/projects/5d503a37c92648158a42c70234cb45ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:13.197989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d503a37c92648158a42c70234cb45ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:13.200482 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:13.358566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d503a37c92648158a42c70234cb45ca', 'request_id': 'req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:13.379033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d503a37c92648158a42c70234cb45ca', 'request_id': 'req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:13.391730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d503a37c92648158a42c70234cb45ca', 'request_id': 'req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:13.437741 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] The token cache is being invalidate because project 5d503a37c92648158a42c70234cb45ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:45:13.438208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:13.441146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9dfc43fd-44e8-4750-ba81-c2b47f1b76b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:45:13.446904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1135/2244] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:45:12 2022] DELETE /identity/v3/projects/5d503a37c92648158a42c70234cb45ca => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:45:13.451667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82727-ef40-4b6f-ab2a-8f35556ae2be None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:13.452209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82727-ef40-4b6f-ab2a-8f35556ae2be None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:13.452209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec82727-ef40-4b6f-ab2a-8f35556ae2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:13.556934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-2ec82727-ef40-4b6f-ab2a-8f35556ae2be None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:13.558123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-2ec82727-ef40-4b6f-ab2a-8f35556ae2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:13.733035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1110/2245] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:13.742998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e66c6-983e-42fb-a494-ca41f57f9494 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:13.743558 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e66c6-983e-42fb-a494-ca41f57f9494 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:13.743783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e66c6-983e-42fb-a494-ca41f57f9494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:13.796046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-359e66c6-983e-42fb-a494-ca41f57f9494 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:13.797476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-359e66c6-983e-42fb-a494-ca41f57f9494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:13.815948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1136/2246] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:13.820443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec82727-ef40-4b6f-ab2a-8f35556ae2be None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:13.826706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:13.833872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec82727-ef40-4b6f-ab2a-8f35556ae2be None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:13.850640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050314-16c1-481c-9541-a546a2bd80cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:13.851767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050314-16c1-481c-9541-a546a2bd80cb admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:13.852273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050314-16c1-481c-9541-a546a2bd80cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:13.852792 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae050314-16c1-481c-9541-a546a2bd80cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:13.853823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae050314-16c1-481c-9541-a546a2bd80cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:45:13.854356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae050314-16c1-481c-9541-a546a2bd80cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:13.859049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae050314-16c1-481c-9541-a546a2bd80cb admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:13.898184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1111/2247] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:45:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:45:13.898545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e66c6-983e-42fb-a494-ca41f57f9494 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:13.921114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e66c6-983e-42fb-a494-ca41f57f9494 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:13.936336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f94c93-4385-4e73-8401-c05fecdf88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:13.937428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f94c93-4385-4e73-8401-c05fecdf88e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:13.947180 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f94c93-4385-4e73-8401-c05fecdf88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:13.947757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f94c93-4385-4e73-8401-c05fecdf88e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:13.948710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f94c93-4385-4e73-8401-c05fecdf88e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:13.951667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f94c93-4385-4e73-8401-c05fecdf88e8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:14.014347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1137/2248] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:45:13 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:45:14.018421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050314-16c1-481c-9541-a546a2bd80cb admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:14.034789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae050314-16c1-481c-9541-a546a2bd80cb admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:14.149363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a4c2-99e5-4076-9bf4-a950b30c6952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:14.150291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a4c2-99e5-4076-9bf4-a950b30c6952 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:14.150977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a4c2-99e5-4076-9bf4-a950b30c6952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:14.151390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52a4c2-99e5-4076-9bf4-a950b30c6952 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:14.152816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52a4c2-99e5-4076-9bf4-a950b30c6952 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:14.156621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52a4c2-99e5-4076-9bf4-a950b30c6952 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:14.209173 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1112/2249] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:45:14 2022] POST /identity/v3/users => generated 287 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:45:14.220022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f94c93-4385-4e73-8401-c05fecdf88e8 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:14.231837 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f94c93-4385-4e73-8401-c05fecdf88e8 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:14.244655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2327a-9cbf-4b1b-8dc9-86a9474514ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:14.245645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2327a-9cbf-4b1b-8dc9-86a9474514ac admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:14.246207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2327a-9cbf-4b1b-8dc9-86a9474514ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:14.246694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be2327a-9cbf-4b1b-8dc9-86a9474514ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:14.247886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2327a-9cbf-4b1b-8dc9-86a9474514ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:14.250110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be2327a-9cbf-4b1b-8dc9-86a9474514ac admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:14.284018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1138/2250] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:45:14.289208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a4c2-99e5-4076-9bf4-a950b30c6952 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:14.303007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52a4c2-99e5-4076-9bf4-a950b30c6952 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:14.311249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2b28e-54a2-40df-b37e-d98f09c84152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:14.312025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b28e-54a2-40df-b37e-d98f09c84152 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:14.312986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b28e-54a2-40df-b37e-d98f09c84152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:14.313279 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2b28e-54a2-40df-b37e-d98f09c84152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:14.314044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b28e-54a2-40df-b37e-d98f09c84152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:14.316099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2b28e-54a2-40df-b37e-d98f09c84152 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:14.344093 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1113/2251] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:45:14.349060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2327a-9cbf-4b1b-8dc9-86a9474514ac admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:14.362592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be2327a-9cbf-4b1b-8dc9-86a9474514ac admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:14.369261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53405f0a-6177-4544-9cb8-21c242158a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:14.370765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53405f0a-6177-4544-9cb8-21c242158a44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:14.370765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53405f0a-6177-4544-9cb8-21c242158a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:14.371534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53405f0a-6177-4544-9cb8-21c242158a44 admin admin] PATH_INFO: `/v3/projects/5c9c69b24fe84b8080b35abaee586f31/users/aefddca517e84383b411886358ef0651/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:14.402311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53405f0a-6177-4544-9cb8-21c242158a44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c9c69b24fe84b8080b35abaee586f31, user_id=aefddca517e84383b411886358ef0651, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:14.405459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53405f0a-6177-4544-9cb8-21c242158a44 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:14.422507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1139/2252] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:45:14 2022] PUT /identity/v3/projects/5c9c69b24fe84b8080b35abaee586f31/users/aefddca517e84383b411886358ef0651/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:45:14.427398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e14a5-b8aa-46f3-a484-0b6e3c1e478e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:14.427693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e14a5-b8aa-46f3-a484-0b6e3c1e478e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:14.427957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586e14a5-b8aa-46f3-a484-0b6e3c1e478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:14.452683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-586e14a5-b8aa-46f3-a484-0b6e3c1e478e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:14.465581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-586e14a5-b8aa-46f3-a484-0b6e3c1e478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:14.546404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1114/2253] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:14.555919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53405f0a-6177-4544-9cb8-21c242158a44 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:14.557677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-53405f0a-6177-4544-9cb8-21c242158a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:14.599722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:14.681326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53405f0a-6177-4544-9cb8-21c242158a44 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:14.696096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a8a66-cc28-45c9-8aa8-6629ca5511c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:14.696787 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a8a66-cc28-45c9-8aa8-6629ca5511c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:14.697233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a8a66-cc28-45c9-8aa8-6629ca5511c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:14.697846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a8a66-cc28-45c9-8aa8-6629ca5511c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:14.728824 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a8a66-cc28-45c9-8aa8-6629ca5511c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:14.733712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a8a66-cc28-45c9-8aa8-6629ca5511c8 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:14.768989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1140/2254] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:23.052589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b84d-3cea-450d-ad7f-1754e466b072 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:23.054556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b84d-3cea-450d-ad7f-1754e466b072 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:23.055206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b84d-3cea-450d-ad7f-1754e466b072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:23.118775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-cfb9b84d-3cea-450d-ad7f-1754e466b072 None None] MFA Rules not processed for user `aefddca517e84383b411886358ef0651`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:23.120685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-cfb9b84d-3cea-450d-ad7f-1754e466b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:23.217757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:23.228623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1115/2255] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:45:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:23.230715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a8a66-cc28-45c9-8aa8-6629ca5511c8 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:23.241478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a8a66-cc28-45c9-8aa8-6629ca5511c8 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:23.250662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e049b8-2698-4b99-906f-a957d9d2b7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:23.251653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e049b8-2698-4b99-906f-a957d9d2b7e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:23.252210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e049b8-2698-4b99-906f-a957d9d2b7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:23.252775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e049b8-2698-4b99-906f-a957d9d2b7e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:23.254032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e049b8-2698-4b99-906f-a957d9d2b7e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:23.257576 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e049b8-2698-4b99-906f-a957d9d2b7e3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:23.293976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1141/2256] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:45:23 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:45:23.300605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9b84d-3cea-450d-ad7f-1754e466b072 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:23.320274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9b84d-3cea-450d-ad7f-1754e466b072 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:23.406728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b3ce-ccfc-4bd0-9694-1129319654ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:23.407718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b3ce-ccfc-4bd0-9694-1129319654ed admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:23.408006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b3ce-ccfc-4bd0-9694-1129319654ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:23.408281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b3ce-ccfc-4bd0-9694-1129319654ed admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:23.409072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077b3ce-ccfc-4bd0-9694-1129319654ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:23.411081 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077b3ce-ccfc-4bd0-9694-1129319654ed admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:23.454342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1116/2257] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:45:23 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:45:23.457776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e049b8-2698-4b99-906f-a957d9d2b7e3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:23.476978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e049b8-2698-4b99-906f-a957d9d2b7e3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:23.484910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23df5-420c-4355-b152-484250addabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:23.486623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23df5-420c-4355-b152-484250addabb admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:23.487262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23df5-420c-4355-b152-484250addabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:23.488429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a23df5-420c-4355-b152-484250addabb admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:23.489708 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a23df5-420c-4355-b152-484250addabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:23.491899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a23df5-420c-4355-b152-484250addabb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:23.524904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1142/2258] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:45:23.530650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b3ce-ccfc-4bd0-9694-1129319654ed admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:23.545147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b3ce-ccfc-4bd0-9694-1129319654ed admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:23.551899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb6e9-501c-479f-8f06-a65f6791106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:23.552949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb6e9-501c-479f-8f06-a65f6791106b admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:23.552949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb6e9-501c-479f-8f06-a65f6791106b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:23.552949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bb6e9-501c-479f-8f06-a65f6791106b admin admin] PATH_INFO: `/v3/projects/eae5cb96ff1b4a45aaa415a9c30c64b4/users/4b25c9a4425945ba9e86d89f103d7834/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:23.571347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb6e9-501c-479f-8f06-a65f6791106b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae5cb96ff1b4a45aaa415a9c30c64b4, user_id=4b25c9a4425945ba9e86d89f103d7834, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:23.574145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35bb6e9-501c-479f-8f06-a65f6791106b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:23.596515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1117/2259] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:45:23 2022] PUT /identity/v3/projects/eae5cb96ff1b4a45aaa415a9c30c64b4/users/4b25c9a4425945ba9e86d89f103d7834/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:45:23.601382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23df5-420c-4355-b152-484250addabb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:23.614321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a23df5-420c-4355-b152-484250addabb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:23.691299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2049ee1e-6046-4431-a8fa-dab269e89c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:23.691979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ee1e-6046-4431-a8fa-dab269e89c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:23.692258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ee1e-6046-4431-a8fa-dab269e89c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:23.692534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2049ee1e-6046-4431-a8fa-dab269e89c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:23.694028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049ee1e-6046-4431-a8fa-dab269e89c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:23.695082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2049ee1e-6046-4431-a8fa-dab269e89c24 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:23.715293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1143/2260] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:45:23.716526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb6e9-501c-479f-8f06-a65f6791106b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:23.730166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bb6e9-501c-479f-8f06-a65f6791106b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:23.735317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d8fdf-777c-442d-93ff-35023adc325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:23.736230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d8fdf-777c-442d-93ff-35023adc325f admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:23.736510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d8fdf-777c-442d-93ff-35023adc325f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:23.736782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d8fdf-777c-442d-93ff-35023adc325f admin admin] PATH_INFO: `/v3/projects/eae5cb96ff1b4a45aaa415a9c30c64b4/users/4b25c9a4425945ba9e86d89f103d7834/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:23.738928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d8fdf-777c-442d-93ff-35023adc325f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eae5cb96ff1b4a45aaa415a9c30c64b4, user_id=4b25c9a4425945ba9e86d89f103d7834, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:23.741627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d8fdf-777c-442d-93ff-35023adc325f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:23.754142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1118/2261] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:45:23 2022] PUT /identity/v3/projects/eae5cb96ff1b4a45aaa415a9c30c64b4/users/4b25c9a4425945ba9e86d89f103d7834/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:45:29.497039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec4a0-77c5-442f-8aa2-6aec59b36cb3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:29.497636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec4a0-77c5-442f-8aa2-6aec59b36cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:29.497636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ec4a0-77c5-442f-8aa2-6aec59b36cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:29.640304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-543ec4a0-77c5-442f-8aa2-6aec59b36cb3 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:29.641490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-543ec4a0-77c5-442f-8aa2-6aec59b36cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:29.826342 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:29.862504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1144/2262] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:45:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:45:29.914545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d8fdf-777c-442d-93ff-35023adc325f admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:29.917254 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c00d8fdf-777c-442d-93ff-35023adc325f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:30.140227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d8fdf-777c-442d-93ff-35023adc325f admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:30.148307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af0ba-fc16-4fb3-b719-50f2e7e6b41d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:30.149088 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af0ba-fc16-4fb3-b719-50f2e7e6b41d service swift] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:30.149378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af0ba-fc16-4fb3-b719-50f2e7e6b41d service swift] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:30.150866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af0ba-fc16-4fb3-b719-50f2e7e6b41d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:30.167130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809af0ba-fc16-4fb3-b719-50f2e7e6b41d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:30.169193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809af0ba-fc16-4fb3-b719-50f2e7e6b41d service swift] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:30.186164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1119/2263] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:45:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:45:34.247164 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35ba9-9cdf-41f8-b432-ebd6f8672c68 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:34.248064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35ba9-9cdf-41f8-b432-ebd6f8672c68 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:34.248547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d35ba9-9cdf-41f8-b432-ebd6f8672c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:34.343560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c1d35ba9-9cdf-41f8-b432-ebd6f8672c68 None None] MFA Rules not processed for user `4b25c9a4425945ba9e86d89f103d7834`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:34.344871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c1d35ba9-9cdf-41f8-b432-ebd6f8672c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:34.566273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1145/2264] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:45:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:34.595931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af0ba-fc16-4fb3-b719-50f2e7e6b41d service swift] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:34.598202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-809af0ba-fc16-4fb3-b719-50f2e7e6b41d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:34.676428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:34.831105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af0ba-fc16-4fb3-b719-50f2e7e6b41d service swift] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:34.839677 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7712d4-a14b-43d9-99da-cd066943f90e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:34.840332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7712d4-a14b-43d9-99da-cd066943f90e service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:34.840614 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7712d4-a14b-43d9-99da-cd066943f90e service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:34.840899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7712d4-a14b-43d9-99da-cd066943f90e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:34.948809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7712d4-a14b-43d9-99da-cd066943f90e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:34.951786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7712d4-a14b-43d9-99da-cd066943f90e service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:34.968433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1120/2265] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:45:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:37.008453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaae6e-2595-44df-ac77-247c12749f3e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:37.008968 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaae6e-2595-44df-ac77-247c12749f3e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:37.009140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacaae6e-2595-44df-ac77-247c12749f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:37.043260 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bacaae6e-2595-44df-ac77-247c12749f3e None None] MFA Rules not processed for user `aefddca517e84383b411886358ef0651`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:37.044673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bacaae6e-2595-44df-ac77-247c12749f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:37.069173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1146/2266] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:45:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:44.961791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=56 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:45.482464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7712d4-a14b-43d9-99da-cd066943f90e service nova] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:45.633142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7712d4-a14b-43d9-99da-cd066943f90e service nova] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:45.648106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fb29f-8f69-4d3b-bc17-17da2e1df262 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:45.648799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fb29f-8f69-4d3b-bc17-17da2e1df262 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:45.649076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fb29f-8f69-4d3b-bc17-17da2e1df262 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:45.649360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fb29f-8f69-4d3b-bc17-17da2e1df262 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:45.651564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-dc1fb29f-8f69-4d3b-bc17-17da2e1df262 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:45.803575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fb29f-8f69-4d3b-bc17-17da2e1df262 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:45.805428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fb29f-8f69-4d3b-bc17-17da2e1df262 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:45.819335 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1121/2267] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:45:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:47.037621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=37 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:52.227971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaae6e-2595-44df-ac77-247c12749f3e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:52.229599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bacaae6e-2595-44df-ac77-247c12749f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:52.325581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacaae6e-2595-44df-ac77-247c12749f3e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:52.330674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40063df-5096-4a1a-8b7b-5a9441f3b668 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582296b1e43f4d12ab99eec9283b0d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:52.331321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40063df-5096-4a1a-8b7b-5a9441f3b668 service placement] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:52.331605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40063df-5096-4a1a-8b7b-5a9441f3b668 service placement] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:52.331883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40063df-5096-4a1a-8b7b-5a9441f3b668 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:52.333656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c40063df-5096-4a1a-8b7b-5a9441f3b668 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:52.347431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40063df-5096-4a1a-8b7b-5a9441f3b668 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:52.349048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40063df-5096-4a1a-8b7b-5a9441f3b668 service placement] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:52.360965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1147/2268] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:45:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:53.601717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222784-fc53-4ad1-8083-ccfd6be3cc85 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:53.602343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222784-fc53-4ad1-8083-ccfd6be3cc85 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:53.602343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2222784-fc53-4ad1-8083-ccfd6be3cc85 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:53.604549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1122/2269] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:45:53.612330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39525b29-f4e6-49bb-949c-e6cd9bd53f6d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:53.612879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39525b29-f4e6-49bb-949c-e6cd9bd53f6d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:53.612879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39525b29-f4e6-49bb-949c-e6cd9bd53f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:53.651448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-39525b29-f4e6-49bb-949c-e6cd9bd53f6d None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:53.652683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-39525b29-f4e6-49bb-949c-e6cd9bd53f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:53.662165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1148/2270] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:53.675516 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2222784-fc53-4ad1-8083-ccfd6be3cc85 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:53.677280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b2222784-fc53-4ad1-8083-ccfd6be3cc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:53.770609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2222784-fc53-4ad1-8083-ccfd6be3cc85 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:53.774274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689c24c-81d9-485d-b345-166a9b85f6c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0edbf66359f1426999f4c28a83f2bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:53.774947 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689c24c-81d9-485d-b345-166a9b85f6c3 service glance] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:53.775228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689c24c-81d9-485d-b345-166a9b85f6c3 service glance] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:53.775504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689c24c-81d9-485d-b345-166a9b85f6c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:53.786700 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689c24c-81d9-485d-b345-166a9b85f6c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:53.788180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689c24c-81d9-485d-b345-166a9b85f6c3 service glance] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:53.799845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1123/2271] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:45:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:53.867747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62ddc-8f92-4d58-90b5-4f9381c732d6 None None] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:53.868036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62ddc-8f92-4d58-90b5-4f9381c732d6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:53.868315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b62ddc-8f92-4d58-90b5-4f9381c732d6 None None] PATH_INFO: `/` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:53.869677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1149/2272] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:45:53.874681 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d519254-70cb-454f-8e0d-f340ca87eb1d None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:53.874970 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d519254-70cb-454f-8e0d-f340ca87eb1d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:53.875248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d519254-70cb-454f-8e0d-f340ca87eb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:53.895177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-6d519254-70cb-454f-8e0d-f340ca87eb1d None None] MFA Rules not processed for user `e4270ab375e04196ad17f121f4175915`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:53.896382 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6d519254-70cb-454f-8e0d-f340ca87eb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:53.904775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1124/2273] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:45:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:53.916323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b62ddc-8f92-4d58-90b5-4f9381c732d6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:53.918234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-16b62ddc-8f92-4d58-90b5-4f9381c732d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:53.932736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b62ddc-8f92-4d58-90b5-4f9381c732d6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:53.936762 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dab1f2b-50f8-4c87-b0c1-f12d635baf3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:53.937401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab1f2b-50f8-4c87-b0c1-f12d635baf3e service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:53.937681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab1f2b-50f8-4c87-b0c1-f12d635baf3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:53.937955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab1f2b-50f8-4c87-b0c1-f12d635baf3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:53.945559 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab1f2b-50f8-4c87-b0c1-f12d635baf3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:53.947019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dab1f2b-50f8-4c87-b0c1-f12d635baf3e service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:53.955132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1150/2274] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:45:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:54.036236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dc100-c172-4237-8bc8-1d33b55192a4 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:54.036580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dc100-c172-4237-8bc8-1d33b55192a4 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:54.036857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dc100-c172-4237-8bc8-1d33b55192a4 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:54.038938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1125/2275] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:45:54.045220 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bdeb6-a5ee-4601-ba4d-0282ce6bc3d8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:54.045512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bdeb6-a5ee-4601-ba4d-0282ce6bc3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:54.045791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bdeb6-a5ee-4601-ba4d-0282ce6bc3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:54.063890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0c5bdeb6-a5ee-4601-ba4d-0282ce6bc3d8 None None] MFA Rules not processed for user `eb66b6f6b5524f3687411fa83d525acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:54.065072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0c5bdeb6-a5ee-4601-ba4d-0282ce6bc3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:54.074907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1151/2276] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:45:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:54.085007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dc100-c172-4237-8bc8-1d33b55192a4 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:54.096719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dc100-c172-4237-8bc8-1d33b55192a4 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:54.100266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4c5d5-a66b-4bd5-b84a-6b0765cae072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:54.100891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4c5d5-a66b-4bd5-b84a-6b0765cae072 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:54.101736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4c5d5-a66b-4bd5-b84a-6b0765cae072 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:54.102019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b4c5d5-a66b-4bd5-b84a-6b0765cae072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:54.112600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4c5d5-a66b-4bd5-b84a-6b0765cae072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:54.114056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b4c5d5-a66b-4bd5-b84a-6b0765cae072 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:54.125183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1126/2277] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:45:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:45:57.268141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925cdc2-9df0-4bab-894b-a865321e5a26 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:57.269001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925cdc2-9df0-4bab-894b-a865321e5a26 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:57.269286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925cdc2-9df0-4bab-894b-a865321e5a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:57.294607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-5925cdc2-9df0-4bab-894b-a865321e5a26 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:45:57.295849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5925cdc2-9df0-4bab-894b-a865321e5a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:45:57.307156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1152/2278] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:45:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:45:57.319572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4c5d5-a66b-4bd5-b84a-6b0765cae072 service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:45:57.331905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b4c5d5-a66b-4bd5-b84a-6b0765cae072 service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:45:57.340302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240667a-7f8e-4379-bbac-e465caee1951 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:45:57.340302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240667a-7f8e-4379-bbac-e465caee1951 service swift] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:45:57.340584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240667a-7f8e-4379-bbac-e465caee1951 service swift] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:45:57.340831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3240667a-7f8e-4379-bbac-e465caee1951 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:45:57.350401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240667a-7f8e-4379-bbac-e465caee1951 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:45:57.351804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3240667a-7f8e-4379-bbac-e465caee1951 service swift] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:45:57.359831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:45:57.367818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1127/2279] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:45:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:46:07.283311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=62 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:17.463487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b6193-f481-4747-82b7-13a09138fcf8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:17.464059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b6193-f481-4747-82b7-13a09138fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:17.464059 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b6193-f481-4747-82b7-13a09138fcf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:17.482386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b35b6193-f481-4747-82b7-13a09138fcf8 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:17.483582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b35b6193-f481-4747-82b7-13a09138fcf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:17.490694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1153/2280] 10.222.0.79 () {58 vars in 967 bytes} [Wed May 25 14:46:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:46:17.503045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240667a-7f8e-4379-bbac-e465caee1951 service swift] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:17.516629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3240667a-7f8e-4379-bbac-e465caee1951 service swift] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:17.522547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af8e69-ea98-425f-af59-ed0ce76f4e1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:17.523942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af8e69-ea98-425f-af59-ed0ce76f4e1a service swift] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:17.523942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af8e69-ea98-425f-af59-ed0ce76f4e1a service swift] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:17.523942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af8e69-ea98-425f-af59-ed0ce76f4e1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:17.533880 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af8e69-ea98-425f-af59-ed0ce76f4e1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:17.535508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af8e69-ea98-425f-af59-ed0ce76f4e1a service swift] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:17.544462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1128/2281] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:46:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:46:21.768380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b6193-f481-4747-82b7-13a09138fcf8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:46:21.778622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b6193-f481-4747-82b7-13a09138fcf8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:46:21.782249 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94992672-c2d8-4394-88ec-4d84dab1d90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:46:21.782896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992672-c2d8-4394-88ec-4d84dab1d90d service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:21.783183 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992672-c2d8-4394-88ec-4d84dab1d90d service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:21.783471 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94992672-c2d8-4394-88ec-4d84dab1d90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:21.795154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94992672-c2d8-4394-88ec-4d84dab1d90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:46:21.796871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94992672-c2d8-4394-88ec-4d84dab1d90d service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:46:21.806773 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1154/2282] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:46:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:46:27.540928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=6 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:31.802234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=9 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:46:55.549133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e93f9-dfba-4ee8-97af-e7f4653e2dc2 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:55.549832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e93f9-dfba-4ee8-97af-e7f4653e2dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:55.549832 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e93f9-dfba-4ee8-97af-e7f4653e2dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:55.572412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-4d9e93f9-dfba-4ee8-97af-e7f4653e2dc2 None None] MFA Rules not processed for user `e26fe8b541484066a2b7c35cd20a4132`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:55.573575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4d9e93f9-dfba-4ee8-97af-e7f4653e2dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:55.647320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1129/2283] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:46:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:46:55.981184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393501-3b73-4c7f-a32d-44f75be7b2f7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:46:55.982228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393501-3b73-4c7f-a32d-44f75be7b2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:46:55.982555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5393501-3b73-4c7f-a32d-44f75be7b2f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:46:56.017573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e5393501-3b73-4c7f-a32d-44f75be7b2f7 None None] MFA Rules not processed for user `4e2fc01480c04ff2988700d0474adebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:46:56.018874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e5393501-3b73-4c7f-a32d-44f75be7b2f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:46:56.088391 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1155/2284] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:46:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:05.639571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=25 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:06.078164 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=25 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:11.654704 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e54a-677e-4367-bf1d-2a901faa66db None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:11.655326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e54a-677e-4367-bf1d-2a901faa66db None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:11.655326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67e54a-677e-4367-bf1d-2a901faa66db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:11.674530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-6f67e54a-677e-4367-bf1d-2a901faa66db None None] MFA Rules not processed for user `1102bd74633c42b6be5f419c16ba89cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:11.676019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6f67e54a-677e-4367-bf1d-2a901faa66db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:11.736361 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1130/2285] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:18.909874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2d8d-ef48-475a-b42a-63e1bc51481d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:18.910489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2d8d-ef48-475a-b42a-63e1bc51481d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:18.910489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c2d8d-ef48-475a-b42a-63e1bc51481d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:18.928181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1d8c2d8d-ef48-475a-b42a-63e1bc51481d None None] MFA Rules not processed for user `43fc4ad124f943c086954c28a0a6e199`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:47:18.929438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1d8c2d8d-ef48-475a-b42a-63e1bc51481d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:18.990241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1156/2286] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:47:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:47:21.729307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=25 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:28.981885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=25 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:47:54.340618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67e54a-677e-4367-bf1d-2a901faa66db None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:47:54.350417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67e54a-677e-4367-bf1d-2a901faa66db None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:47:54.353983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129a295-742b-4131-bad2-f1bf1cc807d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:47:54.354686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a295-742b-4131-bad2-f1bf1cc807d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:47:54.354970 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a295-742b-4131-bad2-f1bf1cc807d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:47:54.355245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129a295-742b-4131-bad2-f1bf1cc807d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:47:54.357049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f129a295-742b-4131-bad2-f1bf1cc807d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:47:54.371040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129a295-742b-4131-bad2-f1bf1cc807d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:47:54.372509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129a295-742b-4131-bad2-f1bf1cc807d8 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:47:54.384706 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1131/2287] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:47:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:00.175313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c2d8d-ef48-475a-b42a-63e1bc51481d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:00.185629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c2d8d-ef48-475a-b42a-63e1bc51481d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:00.189226 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2086a1e-20f3-4b95-8dde-b33b40231f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:00.189863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086a1e-20f3-4b95-8dde-b33b40231f70 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:00.190174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086a1e-20f3-4b95-8dde-b33b40231f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:00.190449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2086a1e-20f3-4b95-8dde-b33b40231f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:00.192204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d2086a1e-20f3-4b95-8dde-b33b40231f70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:00.206875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2086a1e-20f3-4b95-8dde-b33b40231f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:00.208344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2086a1e-20f3-4b95-8dde-b33b40231f70 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:00.219459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1157/2288] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:02.633588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c03956-0165-4607-bb04-60675be6a282 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:02.634107 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c03956-0165-4607-bb04-60675be6a282 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:02.634222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c03956-0165-4607-bb04-60675be6a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:02.653709 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-78c03956-0165-4607-bb04-60675be6a282 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:02.655012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-78c03956-0165-4607-bb04-60675be6a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:02.662861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1132/2289] 10.222.0.79 () {58 vars in 967 bytes} [Wed May 25 14:48:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:02.715000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2086a1e-20f3-4b95-8dde-b33b40231f70 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:02.727002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2086a1e-20f3-4b95-8dde-b33b40231f70 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:02.738567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fb078-65ab-46e4-bb05-bcfbf1f933c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:02.739257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fb078-65ab-46e4-bb05-bcfbf1f933c7 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:02.739537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fb078-65ab-46e4-bb05-bcfbf1f933c7 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:02.739815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0fb078-65ab-46e4-bb05-bcfbf1f933c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:02.749920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fb078-65ab-46e4-bb05-bcfbf1f933c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:02.751658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0fb078-65ab-46e4-bb05-bcfbf1f933c7 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:02.763066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1158/2290] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:48:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:48:04.135953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c03956-0165-4607-bb04-60675be6a282 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:04.137581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-78c03956-0165-4607-bb04-60675be6a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:04.262813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c03956-0165-4607-bb04-60675be6a282 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:04.267907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c2f2f-2cdc-4f8e-ba10-e1a83eb29d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:04.268934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c2f2f-2cdc-4f8e-ba10-e1a83eb29d15 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:04.269436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c2f2f-2cdc-4f8e-ba10-e1a83eb29d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:04.269974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c2f2f-2cdc-4f8e-ba10-e1a83eb29d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:04.274134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-073c2f2f-2cdc-4f8e-ba10-e1a83eb29d15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:04.292257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c2f2f-2cdc-4f8e-ba10-e1a83eb29d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:04.292257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c2f2f-2cdc-4f8e-ba10-e1a83eb29d15 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:04.306702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1133/2291] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:04 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:06.623533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fb078-65ab-46e4-bb05-bcfbf1f933c7 service swift] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:06.636484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0fb078-65ab-46e4-bb05-bcfbf1f933c7 service swift] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:06.646838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06541b0-5510-4510-a7a9-55da9f5073ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582296b1e43f4d12ab99eec9283b0d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:06.647585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06541b0-5510-4510-a7a9-55da9f5073ea service placement] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:06.647867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06541b0-5510-4510-a7a9-55da9f5073ea service placement] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:06.648139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06541b0-5510-4510-a7a9-55da9f5073ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:06.650217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e06541b0-5510-4510-a7a9-55da9f5073ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:06.664308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06541b0-5510-4510-a7a9-55da9f5073ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:06.665994 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06541b0-5510-4510-a7a9-55da9f5073ea service placement] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:06.679743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1159/2292] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:10.514334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02eeef-408c-4fa4-bd58-cd6631114e77 None None] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:10.515569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02eeef-408c-4fa4-bd58-cd6631114e77 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:10.516023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02eeef-408c-4fa4-bd58-cd6631114e77 None None] PATH_INFO: `/` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:10.518154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1134/2293] 10.222.0.79 () {54 vars in 921 bytes} [Wed May 25 14:48:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 14:48:10.550075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815e6b-9553-49a9-954f-c663231380bd None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:10.550673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815e6b-9553-49a9-954f-c663231380bd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:10.551017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa815e6b-9553-49a9-954f-c663231380bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:10.600373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02eeef-408c-4fa4-bd58-cd6631114e77 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:10.602233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ca02eeef-408c-4fa4-bd58-cd6631114e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:10.607743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-fa815e6b-9553-49a9-954f-c663231380bd None None] MFA Rules not processed for user `582296b1e43f4d12ab99eec9283b0d39`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:10.615269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fa815e6b-9553-49a9-954f-c663231380bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:10.627600 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1160/2294] 10.222.0.79 () {58 vars in 1018 bytes} [Wed May 25 14:48:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:10.641442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815e6b-9553-49a9-954f-c663231380bd None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:10.654113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa815e6b-9553-49a9-954f-c663231380bd None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:10.659734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6df18-72ac-4062-ab8d-22a69b2c8d67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582296b1e43f4d12ab99eec9283b0d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:10.660470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6df18-72ac-4062-ab8d-22a69b2c8d67 service placement] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:10.661374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6df18-72ac-4062-ab8d-22a69b2c8d67 service placement] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:10.661841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6df18-72ac-4062-ab8d-22a69b2c8d67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:10.671453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6df18-72ac-4062-ab8d-22a69b2c8d67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:10.673053 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6df18-72ac-4062-ab8d-22a69b2c8d67 service placement] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:10.684389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1161/2295] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:10.692891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02eeef-408c-4fa4-bd58-cd6631114e77 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:10.697712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:10.698665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:10.698943 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:10.699217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] PATH_INFO: `/v3/users/f1858187cb754bbe80bc36713e715d6c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:10.700446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1858187cb754bbe80bc36713e715d6c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:10.702604 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:10.759984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1858187cb754bbe80bc36713e715d6c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:10.761296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1858187cb754bbe80bc36713e715d6c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:10.762140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1858187cb754bbe80bc36713e715d6c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:10.777609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1858187cb754bbe80bc36713e715d6c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:10.778890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:10.788690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1858187cb754bbe80bc36713e715d6c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:10.806036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1135/2296] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:10 2022] DELETE /identity/v3/users/f1858187cb754bbe80bc36713e715d6c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:11.058942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6df18-72ac-4062-ab8d-22a69b2c8d67 service placement] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:11.095062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6df18-72ac-4062-ab8d-22a69b2c8d67 service placement] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:11.241799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:11.242834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:11.243211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:11.243577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] PATH_INFO: `/v3/projects/06668eb815d84458a0ed875b89b26e3d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:11.244913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06668eb815d84458a0ed875b89b26e3d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:11.246996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:11.313945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06668eb815d84458a0ed875b89b26e3d', 'request_id': 'req-7367056d-f10e-43fb-95bb-232dd9738c35'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.324365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06668eb815d84458a0ed875b89b26e3d', 'request_id': 'req-7367056d-f10e-43fb-95bb-232dd9738c35'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.331682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06668eb815d84458a0ed875b89b26e3d', 'request_id': 'req-7367056d-f10e-43fb-95bb-232dd9738c35'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.348874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] The token cache is being invalidate because project 06668eb815d84458a0ed875b89b26e3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:11.349664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.350906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.353888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1162/2297] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:11 2022] DELETE /identity/v3/projects/06668eb815d84458a0ed875b89b26e3d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:11.357610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:11.359094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:11.381965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a8fab-3e4f-49eb-8ac1-f384dad9ee3c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:11.461462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:11.462517 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:11.462766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:11.463240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] PATH_INFO: `/v3/users/bfa3f02a73c7458db84eaf34d1d6c7de` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:11.464534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa3f02a73c7458db84eaf34d1d6c7de)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:11.466564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:11.522217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa3f02a73c7458db84eaf34d1d6c7de'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.523314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa3f02a73c7458db84eaf34d1d6c7de'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.523944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa3f02a73c7458db84eaf34d1d6c7de'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.537622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa3f02a73c7458db84eaf34d1d6c7de'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.545031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa3f02a73c7458db84eaf34d1d6c7de'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.560466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1136/2298] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:11 2022] DELETE /identity/v3/users/bfa3f02a73c7458db84eaf34d1d6c7de => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:11.751195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:11.752765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:11.767042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7367056d-f10e-43fb-95bb-232dd9738c35 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:11.781626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:11.829686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:11.830599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:11.831070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:11.831352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] PATH_INFO: `/v3/projects/504df3b50c7240e7bc0e10fc6282e6ab` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:11.833259 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=504df3b50c7240e7bc0e10fc6282e6ab)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:11.835169 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:11.888902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504df3b50c7240e7bc0e10fc6282e6ab', 'request_id': 'req-e767177d-b870-4646-8422-c001444aae7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.897456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504df3b50c7240e7bc0e10fc6282e6ab', 'request_id': 'req-e767177d-b870-4646-8422-c001444aae7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.904684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504df3b50c7240e7bc0e10fc6282e6ab', 'request_id': 'req-e767177d-b870-4646-8422-c001444aae7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.915944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] The token cache is being invalidate because project 504df3b50c7240e7bc0e10fc6282e6ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:11.916389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.917044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:11.918775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1163/2299] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:11 2022] DELETE /identity/v3/projects/504df3b50c7240e7bc0e10fc6282e6ab => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:13.586184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:13.589368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:13.674119 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:13.693925 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eae0808-ff5a-4179-a22a-0176c2c7b9a2 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:13.720947 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:13.722848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:13.795903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568cd3b-6207-42be-a14a-26960fec986f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:13.796586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568cd3b-6207-42be-a14a-26960fec986f service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:13.796865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568cd3b-6207-42be-a14a-26960fec986f service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:13.797141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568cd3b-6207-42be-a14a-26960fec986f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:13.799161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9568cd3b-6207-42be-a14a-26960fec986f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:13.817713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767177d-b870-4646-8422-c001444aae7d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:13.828088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9ebb-e053-458a-a4d1-ca73956defe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:13.829329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9ebb-e053-458a-a4d1-ca73956defe7 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:13.829329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9ebb-e053-458a-a4d1-ca73956defe7 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:13.829777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb9ebb-e053-458a-a4d1-ca73956defe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:13.833707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c7fb9ebb-e053-458a-a4d1-ca73956defe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:13.879973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568cd3b-6207-42be-a14a-26960fec986f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:13.881977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568cd3b-6207-42be-a14a-26960fec986f service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:13.894576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1137/2300] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:13.899423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:13.920074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9ebb-e053-458a-a4d1-ca73956defe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:13.923642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb9ebb-e053-458a-a4d1-ca73956defe7 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:13.937442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1164/2301] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:48:18.584922 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfbf6e-d310-4964-96e0-c400bb2dd826 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:18.585611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfbf6e-d310-4964-96e0-c400bb2dd826 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:18.585611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcfbf6e-d310-4964-96e0-c400bb2dd826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:18.603789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-edcfbf6e-d310-4964-96e0-c400bb2dd826 None None] MFA Rules not processed for user `4e2fc01480c04ff2988700d0474adebc`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:18.605379 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-edcfbf6e-d310-4964-96e0-c400bb2dd826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:18.616231 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1138/2302] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:18.930463 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9ebb-e053-458a-a4d1-ca73956defe7 service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:18.931971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c7fb9ebb-e053-458a-a4d1-ca73956defe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:18.990319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb9ebb-e053-458a-a4d1-ca73956defe7 service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:18.994107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b45be-d170-4864-a3e7-e8484d921219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:18.994767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b45be-d170-4864-a3e7-e8484d921219 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:18.995051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b45be-d170-4864-a3e7-e8484d921219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:18.995325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b45be-d170-4864-a3e7-e8484d921219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:18.997110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d74b45be-d170-4864-a3e7-e8484d921219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:19.008585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b45be-d170-4864-a3e7-e8484d921219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:19.010356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b45be-d170-4864-a3e7-e8484d921219 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:19.019446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1165/2303] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:19.352619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfbf6e-d310-4964-96e0-c400bb2dd826 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:19.354546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-edcfbf6e-d310-4964-96e0-c400bb2dd826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:19.444505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcfbf6e-d310-4964-96e0-c400bb2dd826 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:19.449566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b63c14-6b60-48e7-b874-6f215dd6631c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582296b1e43f4d12ab99eec9283b0d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:19.450262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b63c14-6b60-48e7-b874-6f215dd6631c service placement] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:19.450545 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b63c14-6b60-48e7-b874-6f215dd6631c service placement] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:19.450817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b63c14-6b60-48e7-b874-6f215dd6631c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:19.452688 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f5b63c14-6b60-48e7-b874-6f215dd6631c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:19.466391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b63c14-6b60-48e7-b874-6f215dd6631c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:19.468448 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b63c14-6b60-48e7-b874-6f215dd6631c service placement] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:19.479620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1139/2304] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:19.531335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b45be-d170-4864-a3e7-e8484d921219 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:19.532821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d74b45be-d170-4864-a3e7-e8484d921219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:19.605537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b45be-d170-4864-a3e7-e8484d921219 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:19.610816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676657bd-0521-4d23-b314-f58fcc51f812 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:19.611906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676657bd-0521-4d23-b314-f58fcc51f812 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:19.612292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676657bd-0521-4d23-b314-f58fcc51f812 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:19.612450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676657bd-0521-4d23-b314-f58fcc51f812 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:19.614870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-676657bd-0521-4d23-b314-f58fcc51f812 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:19.689933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676657bd-0521-4d23-b314-f58fcc51f812 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:19.692129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676657bd-0521-4d23-b314-f58fcc51f812 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:19.702329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1166/2305] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:21.532148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b63c14-6b60-48e7-b874-6f215dd6631c service placement] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:21.545180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b63c14-6b60-48e7-b874-6f215dd6631c service placement] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:21.551755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7ac00-ff9e-446f-b22e-b9268c87ac19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:21.552419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7ac00-ff9e-446f-b22e-b9268c87ac19 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:21.552701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7ac00-ff9e-446f-b22e-b9268c87ac19 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:21.552978 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb7ac00-ff9e-446f-b22e-b9268c87ac19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:21.555043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-dbb7ac00-ff9e-446f-b22e-b9268c87ac19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:21.574913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7ac00-ff9e-446f-b22e-b9268c87ac19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:21.576588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb7ac00-ff9e-446f-b22e-b9268c87ac19 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:21.588372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1140/2306] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:22.636829 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676657bd-0521-4d23-b314-f58fcc51f812 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:22.648807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676657bd-0521-4d23-b314-f58fcc51f812 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:22.653971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85376c-938c-4892-a427-5d8c713f6e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:22.655030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85376c-938c-4892-a427-5d8c713f6e6e service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:22.655376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85376c-938c-4892-a427-5d8c713f6e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:22.655748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85376c-938c-4892-a427-5d8c713f6e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:22.657693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2a85376c-938c-4892-a427-5d8c713f6e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:22.670225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85376c-938c-4892-a427-5d8c713f6e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:22.671875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85376c-938c-4892-a427-5d8c713f6e6e service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:22.680535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1167/2307] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:23.652834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7ac00-ff9e-446f-b22e-b9268c87ac19 service nova] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:23.655367 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-dbb7ac00-ff9e-446f-b22e-b9268c87ac19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:23.669712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb7ac00-ff9e-446f-b22e-b9268c87ac19 service nova] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:23.677313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f6e74-0af0-4551-ba42-164ec14e8ca5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:23.677994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f6e74-0af0-4551-ba42-164ec14e8ca5 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:23.678318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f6e74-0af0-4551-ba42-164ec14e8ca5 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:23.678735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f6e74-0af0-4551-ba42-164ec14e8ca5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:23.680607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f86f6e74-0af0-4551-ba42-164ec14e8ca5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:23.690177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:23.695108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f6e74-0af0-4551-ba42-164ec14e8ca5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:23.696983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f6e74-0af0-4551-ba42-164ec14e8ca5 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:23.709976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1141/2308] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:31.589553 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85376c-938c-4892-a427-5d8c713f6e6e service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:31.591052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2a85376c-938c-4892-a427-5d8c713f6e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:31.602265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85376c-938c-4892-a427-5d8c713f6e6e service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:31.613489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff9fc8-b5d2-406d-b57f-4446c862e6a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:31.614032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff9fc8-b5d2-406d-b57f-4446c862e6a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:31.614352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff9fc8-b5d2-406d-b57f-4446c862e6a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:31.614633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff9fc8-b5d2-406d-b57f-4446c862e6a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:31.616480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a6ff9fc8-b5d2-406d-b57f-4446c862e6a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:31.646791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:31.684219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff9fc8-b5d2-406d-b57f-4446c862e6a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:31.685701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff9fc8-b5d2-406d-b57f-4446c862e6a0 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:31.695797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1168/2309] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:32.771550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f6e74-0af0-4551-ba42-164ec14e8ca5 service nova] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:32.787125 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f6e74-0af0-4551-ba42-164ec14e8ca5 service nova] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:32.797429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe907f-73f8-46d1-b424-cee79ef578c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:32.799199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe907f-73f8-46d1-b424-cee79ef578c5 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:32.801959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe907f-73f8-46d1-b424-cee79ef578c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:32.802373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe907f-73f8-46d1-b424-cee79ef578c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:32.807216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6ffe907f-73f8-46d1-b424-cee79ef578c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:32.824756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe907f-73f8-46d1-b424-cee79ef578c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:32.826413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe907f-73f8-46d1-b424-cee79ef578c5 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:32.845181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1142/2310] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:35.484403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff9fc8-b5d2-406d-b57f-4446c862e6a0 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:35.486478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a6ff9fc8-b5d2-406d-b57f-4446c862e6a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:35.501326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff9fc8-b5d2-406d-b57f-4446c862e6a0 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:35.508057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:35.509002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:35.509333 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:35.509611 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] PATH_INFO: `/v3/users/e26fe8b541484066a2b7c35cd20a4132` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:35.510844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26fe8b541484066a2b7c35cd20a4132)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:35.513061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:35.565434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26fe8b541484066a2b7c35cd20a4132'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:35.573543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26fe8b541484066a2b7c35cd20a4132'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:35.574190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26fe8b541484066a2b7c35cd20a4132'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:35.586685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26fe8b541484066a2b7c35cd20a4132'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:35.593467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-71c21436-7ef4-42dc-a71b-6b00c35dcb4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26fe8b541484066a2b7c35cd20a4132'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:35.599793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1169/2311] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:35 2022] DELETE /identity/v3/users/e26fe8b541484066a2b7c35cd20a4132 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:35.800062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe907f-73f8-46d1-b424-cee79ef578c5 service nova] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:35.815199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe907f-73f8-46d1-b424-cee79ef578c5 service nova] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:35.892886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608525f-b880-4025-af64-070973fea85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:35.893876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608525f-b880-4025-af64-070973fea85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:35.894201 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608525f-b880-4025-af64-070973fea85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:35.894672 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608525f-b880-4025-af64-070973fea85f admin admin] PATH_INFO: `/v3/projects/91398ee1dddc4d97bc909b562cf8e763` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:35.896130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608525f-b880-4025-af64-070973fea85f admin admin] RBAC: Authorizing `identity:delete_project(project_id=91398ee1dddc4d97bc909b562cf8e763)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:35.898282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608525f-b880-4025-af64-070973fea85f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:35.957240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-1608525f-b880-4025-af64-070973fea85f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91398ee1dddc4d97bc909b562cf8e763', 'request_id': 'req-1608525f-b880-4025-af64-070973fea85f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:35.965996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-1608525f-b880-4025-af64-070973fea85f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91398ee1dddc4d97bc909b562cf8e763', 'request_id': 'req-1608525f-b880-4025-af64-070973fea85f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:35.973437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-1608525f-b880-4025-af64-070973fea85f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91398ee1dddc4d97bc909b562cf8e763', 'request_id': 'req-1608525f-b880-4025-af64-070973fea85f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:35.985037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-1608525f-b880-4025-af64-070973fea85f admin admin] The token cache is being invalidate because project 91398ee1dddc4d97bc909b562cf8e763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:35.985421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-1608525f-b880-4025-af64-070973fea85f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:35.986194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-1608525f-b880-4025-af64-070973fea85f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:35.988139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1143/2312] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:35 2022] DELETE /identity/v3/projects/91398ee1dddc4d97bc909b562cf8e763 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:35.992887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817d34-437b-41fc-92f0-1c7556541fe8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:35.993288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817d34-437b-41fc-92f0-1c7556541fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:35.993669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed817d34-437b-41fc-92f0-1c7556541fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.015312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ed817d34-437b-41fc-92f0-1c7556541fe8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:36.017028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ed817d34-437b-41fc-92f0-1c7556541fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:36.098807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1170/2313] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:48:36.107120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45880518-1abe-4f22-abf1-02ae837b6d7e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.107409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45880518-1abe-4f22-abf1-02ae837b6d7e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.107685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45880518-1abe-4f22-abf1-02ae837b6d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.126768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-45880518-1abe-4f22-abf1-02ae837b6d7e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:36.127965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-45880518-1abe-4f22-abf1-02ae837b6d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:36.136276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1144/2314] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:36.140926 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed817d34-437b-41fc-92f0-1c7556541fe8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.151438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed817d34-437b-41fc-92f0-1c7556541fe8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:36.156108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ae840-d7a8-41e2-a858-727842d68515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:36.157143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ae840-d7a8-41e2-a858-727842d68515 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.157642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ae840-d7a8-41e2-a858-727842d68515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.157965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ae840-d7a8-41e2-a858-727842d68515 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.158973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ae840-d7a8-41e2-a858-727842d68515 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:48:36.159292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ae840-d7a8-41e2-a858-727842d68515 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:36.161474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ae840-d7a8-41e2-a858-727842d68515 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:36.174261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1171/2315] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:48:36.178853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45880518-1abe-4f22-abf1-02ae837b6d7e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.188398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45880518-1abe-4f22-abf1-02ae837b6d7e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:36.193871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3945451-3d8c-430a-a8d5-8e7ffa3423e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:36.194678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945451-3d8c-430a-a8d5-8e7ffa3423e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.194961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945451-3d8c-430a-a8d5-8e7ffa3423e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.195234 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3945451-3d8c-430a-a8d5-8e7ffa3423e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.196262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3945451-3d8c-430a-a8d5-8e7ffa3423e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:36.198650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3945451-3d8c-430a-a8d5-8e7ffa3423e5 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:36.230735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1145/2316] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:36 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:36.234948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ae840-d7a8-41e2-a858-727842d68515 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.245936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ae840-d7a8-41e2-a858-727842d68515 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:36.266574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:36.309845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef3781-83e0-46f9-81e2-06a2bf66c42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:36.310577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef3781-83e0-46f9-81e2-06a2bf66c42c admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.310861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef3781-83e0-46f9-81e2-06a2bf66c42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.311139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef3781-83e0-46f9-81e2-06a2bf66c42c admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.311847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef3781-83e0-46f9-81e2-06a2bf66c42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:36.313820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef3781-83e0-46f9-81e2-06a2bf66c42c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:36.338985 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1172/2317] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:36 2022] POST /identity/v3/users => generated 282 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:36.343063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3945451-3d8c-430a-a8d5-8e7ffa3423e5 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.355585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3945451-3d8c-430a-a8d5-8e7ffa3423e5 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:36.360952 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45dc04-7188-4e0a-9a0e-d41e774ed54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:36.362032 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45dc04-7188-4e0a-9a0e-d41e774ed54b admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.362435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45dc04-7188-4e0a-9a0e-d41e774ed54b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.362904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45dc04-7188-4e0a-9a0e-d41e774ed54b admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.363612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45dc04-7188-4e0a-9a0e-d41e774ed54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:36.365382 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45dc04-7188-4e0a-9a0e-d41e774ed54b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:36.378883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1146/2318] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:36.382719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef3781-83e0-46f9-81e2-06a2bf66c42c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.394973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef3781-83e0-46f9-81e2-06a2bf66c42c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:36.400418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca21d52-5fb6-4f20-833c-3280ce76be38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:36.401113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21d52-5fb6-4f20-833c-3280ce76be38 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.401398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21d52-5fb6-4f20-833c-3280ce76be38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.401674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca21d52-5fb6-4f20-833c-3280ce76be38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.402448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca21d52-5fb6-4f20-833c-3280ce76be38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:36.404079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca21d52-5fb6-4f20-833c-3280ce76be38 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:36.419517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1173/2319] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:48:36.420759 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45dc04-7188-4e0a-9a0e-d41e774ed54b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.442455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45dc04-7188-4e0a-9a0e-d41e774ed54b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:36.447933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecb71e-9f71-48c1-925c-3fa7497a6cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:36.449208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecb71e-9f71-48c1-925c-3fa7497a6cee admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.449499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecb71e-9f71-48c1-925c-3fa7497a6cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.449983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ecb71e-9f71-48c1-925c-3fa7497a6cee admin admin] PATH_INFO: `/v3/projects/59da47f653d84f54a4d00deb6e75b6e3/users/20f5ff6c8ed9446e8763256fc95a1392/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.473597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecb71e-9f71-48c1-925c-3fa7497a6cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=59da47f653d84f54a4d00deb6e75b6e3, user_id=20f5ff6c8ed9446e8763256fc95a1392, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:36.478901 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ecb71e-9f71-48c1-925c-3fa7497a6cee admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:36.505230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1147/2320] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:36 2022] PUT /identity/v3/projects/59da47f653d84f54a4d00deb6e75b6e3/users/20f5ff6c8ed9446e8763256fc95a1392/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:36.524126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4635a-effe-4217-934b-6f06465c321b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.524911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4635a-effe-4217-934b-6f06465c321b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.526321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4635a-effe-4217-934b-6f06465c321b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.557949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6ba4635a-effe-4217-934b-6f06465c321b None None] MFA Rules not processed for user `20f5ff6c8ed9446e8763256fc95a1392`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:36.559600 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6ba4635a-effe-4217-934b-6f06465c321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:36.641605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1174/2321] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:36.647036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecb71e-9f71-48c1-925c-3fa7497a6cee admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.660793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:36.720977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ecb71e-9f71-48c1-925c-3fa7497a6cee admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:36.725888 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3712e-36d1-4c34-92d9-0ce9a0c864e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:36.726594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3712e-36d1-4c34-92d9-0ce9a0c864e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.726902 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3712e-36d1-4c34-92d9-0ce9a0c864e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.727422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3712e-36d1-4c34-92d9-0ce9a0c864e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.727865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3712e-36d1-4c34-92d9-0ce9a0c864e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:36.729785 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d3712e-36d1-4c34-92d9-0ce9a0c864e1 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:36.759805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1148/2322] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:36 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:48:36.764215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4635a-effe-4217-934b-6f06465c321b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.775971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4635a-effe-4217-934b-6f06465c321b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:36.846520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f301b-2c49-4362-8608-eb1c4de9d1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:36.847246 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f301b-2c49-4362-8608-eb1c4de9d1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.847535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f301b-2c49-4362-8608-eb1c4de9d1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.847816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084f301b-2c49-4362-8608-eb1c4de9d1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.848543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f301b-2c49-4362-8608-eb1c4de9d1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:36.850564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084f301b-2c49-4362-8608-eb1c4de9d1f3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:36.872608 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1175/2323] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:36 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:36.876724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3712e-36d1-4c34-92d9-0ce9a0c864e1 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.888070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3712e-36d1-4c34-92d9-0ce9a0c864e1 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:36.893881 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9459d-c018-4313-9171-abb614f35fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:36.894373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9459d-c018-4313-9171-abb614f35fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.894665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9459d-c018-4313-9171-abb614f35fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.894938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca9459d-c018-4313-9171-abb614f35fd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.895679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9459d-c018-4313-9171-abb614f35fd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:36.897321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca9459d-c018-4313-9171-abb614f35fd7 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:36.909826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1149/2324] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:48:36.914349 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f301b-2c49-4362-8608-eb1c4de9d1f3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.925718 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084f301b-2c49-4362-8608-eb1c4de9d1f3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:36.930508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9836-b7f8-4b10-ae9a-4f0d44468cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:36.931402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9836-b7f8-4b10-ae9a-4f0d44468cd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:36.931687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9836-b7f8-4b10-ae9a-4f0d44468cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:36.931965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9836-b7f8-4b10-ae9a-4f0d44468cd9 admin admin] PATH_INFO: `/v3/projects/c3848abb407048009d2de72746b6b19c/users/07101931ed7848ec8f90e9a44022ee12/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:36.948000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb9836-b7f8-4b10-ae9a-4f0d44468cd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3848abb407048009d2de72746b6b19c, user_id=07101931ed7848ec8f90e9a44022ee12, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:36.950761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb9836-b7f8-4b10-ae9a-4f0d44468cd9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:36.954278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:36.967138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1176/2325] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:36 2022] PUT /identity/v3/projects/c3848abb407048009d2de72746b6b19c/users/07101931ed7848ec8f90e9a44022ee12/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:36.971129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9459d-c018-4313-9171-abb614f35fd7 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:36.981262 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca9459d-c018-4313-9171-abb614f35fd7 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:37.047534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a7724-2ab0-4185-ae1c-7c5c63d278f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:37.048231 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7724-2ab0-4185-ae1c-7c5c63d278f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:37.048608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7724-2ab0-4185-ae1c-7c5c63d278f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:37.049289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a7724-2ab0-4185-ae1c-7c5c63d278f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:37.050038 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a7724-2ab0-4185-ae1c-7c5c63d278f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:37.051731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a7724-2ab0-4185-ae1c-7c5c63d278f1 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:37.063793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1150/2326] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:37.070431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9836-b7f8-4b10-ae9a-4f0d44468cd9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:37.081429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9836-b7f8-4b10-ae9a-4f0d44468cd9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:37.086728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfcfba-e119-46be-a062-2d397d9d534f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:37.087607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcfba-e119-46be-a062-2d397d9d534f admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:37.087884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcfba-e119-46be-a062-2d397d9d534f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:37.088155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfcfba-e119-46be-a062-2d397d9d534f admin admin] PATH_INFO: `/v3/projects/c3848abb407048009d2de72746b6b19c/users/07101931ed7848ec8f90e9a44022ee12/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:37.090157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfcfba-e119-46be-a062-2d397d9d534f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3848abb407048009d2de72746b6b19c, user_id=07101931ed7848ec8f90e9a44022ee12, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:37.093340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfcfba-e119-46be-a062-2d397d9d534f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:37.103797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1177/2327] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:37 2022] PUT /identity/v3/projects/c3848abb407048009d2de72746b6b19c/users/07101931ed7848ec8f90e9a44022ee12/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:37.116126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bc384-d1c2-45ab-9ea2-bd09031de28f None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:37.116417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bc384-d1c2-45ab-9ea2-bd09031de28f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:37.116692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bc384-d1c2-45ab-9ea2-bd09031de28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:37.145592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e09bc384-d1c2-45ab-9ea2-bd09031de28f None None] MFA Rules not processed for user `07101931ed7848ec8f90e9a44022ee12`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:37.146748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e09bc384-d1c2-45ab-9ea2-bd09031de28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:37.217386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1151/2328] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:37.228884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfcfba-e119-46be-a062-2d397d9d534f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:37.230693 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0bbfcfba-e119-46be-a062-2d397d9d534f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:37.294028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfcfba-e119-46be-a062-2d397d9d534f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:37.298290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34528cf2-70c7-4d89-a051-b313543f19a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:37.298919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34528cf2-70c7-4d89-a051-b313543f19a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:37.299223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34528cf2-70c7-4d89-a051-b313543f19a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:37.299484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34528cf2-70c7-4d89-a051-b313543f19a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:37.319424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34528cf2-70c7-4d89-a051-b313543f19a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:37.320894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34528cf2-70c7-4d89-a051-b313543f19a5 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:37.331227 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1178/2329] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:37.802761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bc384-d1c2-45ab-9ea2-bd09031de28f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:37.804734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e09bc384-d1c2-45ab-9ea2-bd09031de28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:37.812670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:37.847595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34528cf2-70c7-4d89-a051-b313543f19a5 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:37.897354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bc384-d1c2-45ab-9ea2-bd09031de28f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:37.901481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c19da8-b1c1-444e-9a0b-d110f3d06036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:37.902198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19da8-b1c1-444e-9a0b-d110f3d06036 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:37.902514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19da8-b1c1-444e-9a0b-d110f3d06036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:37.902794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c19da8-b1c1-444e-9a0b-d110f3d06036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:37.904735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-82c19da8-b1c1-444e-9a0b-d110f3d06036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:37.960377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34528cf2-70c7-4d89-a051-b313543f19a5 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:37.965922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:37.967654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:37.967944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:37.968218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] PATH_INFO: `/v3/users/20f5ff6c8ed9446e8763256fc95a1392` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:37.969989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] RBAC: Authorizing `identity:delete_user(user_id=20f5ff6c8ed9446e8763256fc95a1392)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:37.972952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:37.990416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19da8-b1c1-444e-9a0b-d110f3d06036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:37.993110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c19da8-b1c1-444e-9a0b-d110f3d06036 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:38.009950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1152/2330] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:48:38.038281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20f5ff6c8ed9446e8763256fc95a1392'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:38.052628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20f5ff6c8ed9446e8763256fc95a1392'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:38.053535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20f5ff6c8ed9446e8763256fc95a1392'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:38.069903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20f5ff6c8ed9446e8763256fc95a1392'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:38.080934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20f5ff6c8ed9446e8763256fc95a1392'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:38.093678 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1179/2331] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:37 2022] DELETE /identity/v3/users/20f5ff6c8ed9446e8763256fc95a1392 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:38.102351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd89b1-fa2c-4da3-b3c8-612d2fe9c11c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:38.102699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd89b1-fa2c-4da3-b3c8-612d2fe9c11c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:38.102944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd89b1-fa2c-4da3-b3c8-612d2fe9c11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:38.124043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-3dbd89b1-fa2c-4da3-b3c8-612d2fe9c11c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:38.125368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3dbd89b1-fa2c-4da3-b3c8-612d2fe9c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:38.215529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1153/2332] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:48:38.236269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:38.237807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:38.246317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:38.323148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54220a97-8289-44fc-b023-38a956a3e62e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:38.327710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e14c7-e01d-41e3-b96e-21a3d349603e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:38.328509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e14c7-e01d-41e3-b96e-21a3d349603e service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:38.328991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e14c7-e01d-41e3-b96e-21a3d349603e service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:38.329493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e14c7-e01d-41e3-b96e-21a3d349603e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:38.341585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e14c7-e01d-41e3-b96e-21a3d349603e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:38.343767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9e14c7-e01d-41e3-b96e-21a3d349603e service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:38.368631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1180/2333] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:38.957392 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd89b1-fa2c-4da3-b3c8-612d2fe9c11c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:38.959184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3dbd89b1-fa2c-4da3-b3c8-612d2fe9c11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:38.990782 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd89b1-fa2c-4da3-b3c8-612d2fe9c11c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:39.014266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:39.023512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:39.024154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:39.024602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] PATH_INFO: `/v3/projects/59da47f653d84f54a4d00deb6e75b6e3` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:39.027715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=59da47f653d84f54a4d00deb6e75b6e3)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:39.030883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:39.155290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8cae3-95db-46fd-9646-948e6bfdc034 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:39.155919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8cae3-95db-46fd-9646-948e6bfdc034 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:39.155919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8cae3-95db-46fd-9646-948e6bfdc034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:39.159096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:39.160637 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59da47f653d84f54a4d00deb6e75b6e3', 'request_id': 'req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:39.171427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59da47f653d84f54a4d00deb6e75b6e3', 'request_id': 'req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:39.181137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59da47f653d84f54a4d00deb6e75b6e3', 'request_id': 'req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:39.182452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-eee8cae3-95db-46fd-9646-948e6bfdc034 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:39.184492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-eee8cae3-95db-46fd-9646-948e6bfdc034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:39.197918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] The token cache is being invalidate because project 59da47f653d84f54a4d00deb6e75b6e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:39.198966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:39.200103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:39.203386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1154/2334] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:38 2022] DELETE /identity/v3/projects/59da47f653d84f54a4d00deb6e75b6e3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:39.210274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:39.212317 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:39.296159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1181/2335] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:48:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:39.305786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba139557-f8bd-4e1f-8fbb-c1b61392afdc admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:39.310779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:39.312111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:39.312407 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:39.312627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8cae3-95db-46fd-9646-948e6bfdc034 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:39.312758 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] PATH_INFO: `/v3/users/07101931ed7848ec8f90e9a44022ee12` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:39.314227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07101931ed7848ec8f90e9a44022ee12)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:39.314360 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-eee8cae3-95db-46fd-9646-948e6bfdc034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:39.316758 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:39.386696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07101931ed7848ec8f90e9a44022ee12'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:39.387392 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07101931ed7848ec8f90e9a44022ee12'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:39.388914 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07101931ed7848ec8f90e9a44022ee12'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:39.402961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07101931ed7848ec8f90e9a44022ee12'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:39.412856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07101931ed7848ec8f90e9a44022ee12'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:39.427469 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8cae3-95db-46fd-9646-948e6bfdc034 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:39.432969 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1155/2336] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:39 2022] DELETE /identity/v3/users/07101931ed7848ec8f90e9a44022ee12 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:39.435918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4dd6d-bdd6-4f8b-adcc-6e2147b4d393 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:39.436861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4dd6d-bdd6-4f8b-adcc-6e2147b4d393 service swift] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:39.437086 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4dd6d-bdd6-4f8b-adcc-6e2147b4d393 service swift] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:39.437363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4dd6d-bdd6-4f8b-adcc-6e2147b4d393 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:39.439230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-46d4dd6d-bdd6-4f8b-adcc-6e2147b4d393 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:39.451144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4dd6d-bdd6-4f8b-adcc-6e2147b4d393 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:39.452774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d4dd6d-bdd6-4f8b-adcc-6e2147b4d393 service swift] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:39.461631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1182/2337] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:48:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:48:40.137292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:40.139757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:40.287842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:40.291950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d721f8f-df4a-46ae-bab2-59e71cd788c4 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:40.312740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:40.313666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:40.314115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:40.314326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] PATH_INFO: `/v3/projects/c3848abb407048009d2de72746b6b19c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:40.315848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3848abb407048009d2de72746b6b19c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:40.319384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:40.459146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3848abb407048009d2de72746b6b19c', 'request_id': 'req-67e8fdd9-8258-4029-8113-cc2c43892f81'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:40.483286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3848abb407048009d2de72746b6b19c', 'request_id': 'req-67e8fdd9-8258-4029-8113-cc2c43892f81'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:40.492219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3848abb407048009d2de72746b6b19c', 'request_id': 'req-67e8fdd9-8258-4029-8113-cc2c43892f81'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:40.523041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] The token cache is being invalidate because project c3848abb407048009d2de72746b6b19c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:40.525352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:40.526492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-67e8fdd9-8258-4029-8113-cc2c43892f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:40.532993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1156/2338] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:40 2022] DELETE /identity/v3/projects/c3848abb407048009d2de72746b6b19c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:40.536489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df399f69-88d4-4cf9-8040-d169357d0930 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:40.537112 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df399f69-88d4-4cf9-8040-d169357d0930 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:40.537359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df399f69-88d4-4cf9-8040-d169357d0930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:40.594650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-df399f69-88d4-4cf9-8040-d169357d0930 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:40.596110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-df399f69-88d4-4cf9-8040-d169357d0930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:40.712830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:40.747730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1183/2339] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:40.757961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38028a-5b7f-4d6e-80f1-6f6c9c93887f None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:40.758366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38028a-5b7f-4d6e-80f1-6f6c9c93887f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:40.758802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38028a-5b7f-4d6e-80f1-6f6c9c93887f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:40.817026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1d38028a-5b7f-4d6e-80f1-6f6c9c93887f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:40.819533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1d38028a-5b7f-4d6e-80f1-6f6c9c93887f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:40.882179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1157/2340] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:40.885825 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df399f69-88d4-4cf9-8040-d169357d0930 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:40.904953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df399f69-88d4-4cf9-8040-d169357d0930 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:40.927979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c29cb-599b-4cc9-a7c5-7d5f6356c29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:40.932274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c29cb-599b-4cc9-a7c5-7d5f6356c29d admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:40.932274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c29cb-599b-4cc9-a7c5-7d5f6356c29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:40.932274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c29cb-599b-4cc9-a7c5-7d5f6356c29d admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:40.932274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c29cb-599b-4cc9-a7c5-7d5f6356c29d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:48:40.932700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c29cb-599b-4cc9-a7c5-7d5f6356c29d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:40.934285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c29cb-599b-4cc9-a7c5-7d5f6356c29d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:40.980527 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1184/2341] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:48:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:48:40.983727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38028a-5b7f-4d6e-80f1-6f6c9c93887f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:40.995347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38028a-5b7f-4d6e-80f1-6f6c9c93887f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:41.017905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3d52d-8812-4334-9bb6-5ee819fb8d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:41.018618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d52d-8812-4334-9bb6-5ee819fb8d04 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:41.019577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d52d-8812-4334-9bb6-5ee819fb8d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:41.019912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3d52d-8812-4334-9bb6-5ee819fb8d04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:41.020822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3d52d-8812-4334-9bb6-5ee819fb8d04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:41.028270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3d52d-8812-4334-9bb6-5ee819fb8d04 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:41.152519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1158/2342] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:40 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:41.156548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c29cb-599b-4cc9-a7c5-7d5f6356c29d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:41.184108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c29cb-599b-4cc9-a7c5-7d5f6356c29d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:41.290317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5739a-b255-416c-a843-4551faafa0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:41.291009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5739a-b255-416c-a843-4551faafa0d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:41.291297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5739a-b255-416c-a843-4551faafa0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:41.291578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5739a-b255-416c-a843-4551faafa0d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:41.292274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5739a-b255-416c-a843-4551faafa0d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:41.294310 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5739a-b255-416c-a843-4551faafa0d6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:41.328052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1185/2343] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:41 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:41.332471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3d52d-8812-4334-9bb6-5ee819fb8d04 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:41.351503 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3d52d-8812-4334-9bb6-5ee819fb8d04 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:41.363311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff99679-6c42-4c52-bc6e-31a35111d11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:41.364213 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff99679-6c42-4c52-bc6e-31a35111d11d admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:41.364450 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff99679-6c42-4c52-bc6e-31a35111d11d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:41.364778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff99679-6c42-4c52-bc6e-31a35111d11d admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:41.365638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff99679-6c42-4c52-bc6e-31a35111d11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:41.367701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff99679-6c42-4c52-bc6e-31a35111d11d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:41.400025 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1159/2344] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:41.404258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5739a-b255-416c-a843-4551faafa0d6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:41.418285 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5739a-b255-416c-a843-4551faafa0d6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:41.427015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd0f1e-68cc-40aa-aa95-5ac0fe12429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:41.427781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd0f1e-68cc-40aa-aa95-5ac0fe12429f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:41.428146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd0f1e-68cc-40aa-aa95-5ac0fe12429f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:41.428496 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd0f1e-68cc-40aa-aa95-5ac0fe12429f admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:41.431823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd0f1e-68cc-40aa-aa95-5ac0fe12429f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:41.433659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd0f1e-68cc-40aa-aa95-5ac0fe12429f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:41.455805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1186/2345] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:48:41.457727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff99679-6c42-4c52-bc6e-31a35111d11d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:41.474319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff99679-6c42-4c52-bc6e-31a35111d11d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:41.482189 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df36ff-025d-4e17-8ed5-f7f5a7ef804c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:41.483087 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df36ff-025d-4e17-8ed5-f7f5a7ef804c admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:41.483457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df36ff-025d-4e17-8ed5-f7f5a7ef804c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:41.483746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df36ff-025d-4e17-8ed5-f7f5a7ef804c admin admin] PATH_INFO: `/v3/projects/4058bf566f0f48fdae56db3965ab0e62/users/25360e3910e242a2894140a434eca8c3/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:41.508084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df36ff-025d-4e17-8ed5-f7f5a7ef804c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4058bf566f0f48fdae56db3965ab0e62, user_id=25360e3910e242a2894140a434eca8c3, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:41.512088 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df36ff-025d-4e17-8ed5-f7f5a7ef804c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:41.544455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1160/2346] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:41 2022] PUT /identity/v3/projects/4058bf566f0f48fdae56db3965ab0e62/users/25360e3910e242a2894140a434eca8c3/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:41.548417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fff32e-5f01-413e-8f40-f74e2bb940a6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:41.548978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fff32e-5f01-413e-8f40-f74e2bb940a6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:41.549489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fff32e-5f01-413e-8f40-f74e2bb940a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:41.603876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c8fff32e-5f01-413e-8f40-f74e2bb940a6 None None] MFA Rules not processed for user `25360e3910e242a2894140a434eca8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:41.606676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c8fff32e-5f01-413e-8f40-f74e2bb940a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:41.713461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1187/2347] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:41.718540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df36ff-025d-4e17-8ed5-f7f5a7ef804c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:41.843899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df36ff-025d-4e17-8ed5-f7f5a7ef804c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:41.860327 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ba571-6899-4a5d-b510-7b67bfe0a5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:41.861455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ba571-6899-4a5d-b510-7b67bfe0a5fd admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:41.862259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ba571-6899-4a5d-b510-7b67bfe0a5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:41.862594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ba571-6899-4a5d-b510-7b67bfe0a5fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:41.863321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ba571-6899-4a5d-b510-7b67bfe0a5fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:41.865288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ba571-6899-4a5d-b510-7b67bfe0a5fd admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:41.900875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:41.922702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1161/2348] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:41 2022] POST /identity/v3/projects => generated 387 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:41.935470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fff32e-5f01-413e-8f40-f74e2bb940a6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:41.957293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fff32e-5f01-413e-8f40-f74e2bb940a6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:42.020139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:42.063165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0a1ba-f225-4656-bc1a-a89bfc6a25c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:42.064373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0a1ba-f225-4656-bc1a-a89bfc6a25c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:42.064876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0a1ba-f225-4656-bc1a-a89bfc6a25c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:42.065531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0a1ba-f225-4656-bc1a-a89bfc6a25c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:42.067386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0a1ba-f225-4656-bc1a-a89bfc6a25c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:42.070186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0a1ba-f225-4656-bc1a-a89bfc6a25c6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:42.119658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1188/2349] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:41 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:42.125538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ba571-6899-4a5d-b510-7b67bfe0a5fd admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:42.164213 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ba571-6899-4a5d-b510-7b67bfe0a5fd admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:42.182548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ebdaa-8e68-4f6f-be38-545cec93d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:42.183867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ebdaa-8e68-4f6f-be38-545cec93d330 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:42.184387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ebdaa-8e68-4f6f-be38-545cec93d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:42.184893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ebdaa-8e68-4f6f-be38-545cec93d330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:42.186866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ebdaa-8e68-4f6f-be38-545cec93d330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:42.189631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ebdaa-8e68-4f6f-be38-545cec93d330 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:42.210190 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1162/2350] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:42.225827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0a1ba-f225-4656-bc1a-a89bfc6a25c6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:42.258660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0a1ba-f225-4656-bc1a-a89bfc6a25c6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:42.272462 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba040ff-33a7-433a-b132-d00a64fa9e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:42.280449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba040ff-33a7-433a-b132-d00a64fa9e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:42.281173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba040ff-33a7-433a-b132-d00a64fa9e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:42.281650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba040ff-33a7-433a-b132-d00a64fa9e64 admin admin] PATH_INFO: `/v3/projects/ffbd153bf2bc467197703292788ea529/users/075bbf110ab54a568d86e97fb486958b/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:42.301840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba040ff-33a7-433a-b132-d00a64fa9e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbd153bf2bc467197703292788ea529, user_id=075bbf110ab54a568d86e97fb486958b, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:42.306147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba040ff-33a7-433a-b132-d00a64fa9e64 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:42.359473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1189/2351] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:42 2022] PUT /identity/v3/projects/ffbd153bf2bc467197703292788ea529/users/075bbf110ab54a568d86e97fb486958b/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:42.363969 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ebdaa-8e68-4f6f-be38-545cec93d330 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:42.380299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ebdaa-8e68-4f6f-be38-545cec93d330 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:42.529914 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c0f65-a1f0-49a8-a3ef-f446da9ef2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:42.530722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c0f65-a1f0-49a8-a3ef-f446da9ef2b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:42.531031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c0f65-a1f0-49a8-a3ef-f446da9ef2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:42.531318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c0f65-a1f0-49a8-a3ef-f446da9ef2b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:42.532067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c0f65-a1f0-49a8-a3ef-f446da9ef2b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:42.536197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c0f65-a1f0-49a8-a3ef-f446da9ef2b7 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:42.549667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1163/2352] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:42.554859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba040ff-33a7-433a-b132-d00a64fa9e64 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:42.586722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba040ff-33a7-433a-b132-d00a64fa9e64 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:42.603097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6af3-fec5-4ea2-bbaa-26e51548c742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:42.603097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6af3-fec5-4ea2-bbaa-26e51548c742 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:42.603097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6af3-fec5-4ea2-bbaa-26e51548c742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:42.603097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e6af3-fec5-4ea2-bbaa-26e51548c742 admin admin] PATH_INFO: `/v3/projects/ffbd153bf2bc467197703292788ea529/users/075bbf110ab54a568d86e97fb486958b/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:42.603453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e6af3-fec5-4ea2-bbaa-26e51548c742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffbd153bf2bc467197703292788ea529, user_id=075bbf110ab54a568d86e97fb486958b, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:42.603453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e6af3-fec5-4ea2-bbaa-26e51548c742 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:42.643727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1190/2353] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:42 2022] PUT /identity/v3/projects/ffbd153bf2bc467197703292788ea529/users/075bbf110ab54a568d86e97fb486958b/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:42.648163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a632419-cb3b-4d6f-9bb0-71b970092cc6 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:42.648460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a632419-cb3b-4d6f-9bb0-71b970092cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:42.648748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a632419-cb3b-4d6f-9bb0-71b970092cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:42.738566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1a632419-cb3b-4d6f-9bb0-71b970092cc6 None None] MFA Rules not processed for user `075bbf110ab54a568d86e97fb486958b`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:42.742389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1a632419-cb3b-4d6f-9bb0-71b970092cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:42.958395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1164/2354] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:48:42.975281 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6af3-fec5-4ea2-bbaa-26e51548c742 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:42.977872 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4e6e6af3-fec5-4ea2-bbaa-26e51548c742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:43.188540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e6af3-fec5-4ea2-bbaa-26e51548c742 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:43.201132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8273a-f372-4104-ada4-4bc55ecca813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:43.202317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8273a-f372-4104-ada4-4bc55ecca813 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:43.203572 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8273a-f372-4104-ada4-4bc55ecca813 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:43.203857 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8273a-f372-4104-ada4-4bc55ecca813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:43.227809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8273a-f372-4104-ada4-4bc55ecca813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:43.228229 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8273a-f372-4104-ada4-4bc55ecca813 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:43.257446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1191/2355] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:43.359548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a632419-cb3b-4d6f-9bb0-71b970092cc6 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:43.385500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8273a-f372-4104-ada4-4bc55ecca813 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:43.386980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-abb8273a-f372-4104-ada4-4bc55ecca813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:43.512144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a632419-cb3b-4d6f-9bb0-71b970092cc6 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:43.535035 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:43.540066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:43.540610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:43.540991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] PATH_INFO: `/v3/users/25360e3910e242a2894140a434eca8c3` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:43.543687 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25360e3910e242a2894140a434eca8c3)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:43.545788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:43.552779 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8273a-f372-4104-ada4-4bc55ecca813 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:43.557799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:43.558928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:43.559316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:43.559700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] PATH_INFO: `/v3/users/1102bd74633c42b6be5f419c16ba89cb` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:43.560477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:43.561307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1102bd74633c42b6be5f419c16ba89cb)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:43.563424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:43.614006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25360e3910e242a2894140a434eca8c3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:43.615141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25360e3910e242a2894140a434eca8c3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:43.615905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25360e3910e242a2894140a434eca8c3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:43.637976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:43.644869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25360e3910e242a2894140a434eca8c3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:43.656598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1102bd74633c42b6be5f419c16ba89cb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:43.665970 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bb0ad626-0bb8-4b24-b6e4-4c919a473de1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25360e3910e242a2894140a434eca8c3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:43.674075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1102bd74633c42b6be5f419c16ba89cb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:43.675387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1102bd74633c42b6be5f419c16ba89cb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:43.713455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1165/2356] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:43 2022] DELETE /identity/v3/users/25360e3910e242a2894140a434eca8c3 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:43.716225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1102bd74633c42b6be5f419c16ba89cb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:43.717997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9cecc-ddde-4f39-a121-398edb86572b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:43.719546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9cecc-ddde-4f39-a121-398edb86572b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:43.719921 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9cecc-ddde-4f39-a121-398edb86572b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:43.743908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-20d9cecc-ddde-4f39-a121-398edb86572b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:43.744779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-20d9cecc-ddde-4f39-a121-398edb86572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:43.748279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1102bd74633c42b6be5f419c16ba89cb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:43.763396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1192/2357] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:43 2022] DELETE /identity/v3/users/1102bd74633c42b6be5f419c16ba89cb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:43.880366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1166/2358] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:43.900737 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:43.902341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:44.023322 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b9941f-4a64-4b42-9b56-f8dc4d436ecc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:44.024780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9cecc-ddde-4f39-a121-398edb86572b None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:44.026204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-20d9cecc-ddde-4f39-a121-398edb86572b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:44.029149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e21e19-c8f5-40f9-9591-a13206c39c0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:44.029818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e21e19-c8f5-40f9-9591-a13206c39c0c service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:44.030131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e21e19-c8f5-40f9-9591-a13206c39c0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:44.030418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e21e19-c8f5-40f9-9591-a13206c39c0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:44.040291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9cecc-ddde-4f39-a121-398edb86572b None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:44.154364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:44.155289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:44.155589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:44.155858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] PATH_INFO: `/v3/projects/e61e8f31edc94a3ea6c23b3fd0aac04a` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:44.157210 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e61e8f31edc94a3ea6c23b3fd0aac04a)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:44.159794 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:44.161613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e21e19-c8f5-40f9-9591-a13206c39c0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:44.163397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e21e19-c8f5-40f9-9591-a13206c39c0c service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:44.182511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1193/2359] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:44.224977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:44.250660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e61e8f31edc94a3ea6c23b3fd0aac04a', 'request_id': 'req-4bba1bb8-7244-40e5-bc57-9d8a35659233'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:44.260934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e61e8f31edc94a3ea6c23b3fd0aac04a', 'request_id': 'req-4bba1bb8-7244-40e5-bc57-9d8a35659233'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:44.275172 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e61e8f31edc94a3ea6c23b3fd0aac04a', 'request_id': 'req-4bba1bb8-7244-40e5-bc57-9d8a35659233'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:44.303022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] The token cache is being invalidate because project e61e8f31edc94a3ea6c23b3fd0aac04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:44.303465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:44.304470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4bba1bb8-7244-40e5-bc57-9d8a35659233 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:44.306875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1167/2360] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:44 2022] DELETE /identity/v3/projects/e61e8f31edc94a3ea6c23b3fd0aac04a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:44.318657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2d3cb-8387-482a-b176-ea67f4fa3df2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:44.319151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2d3cb-8387-482a-b176-ea67f4fa3df2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:44.319606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2d3cb-8387-482a-b176-ea67f4fa3df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:44.354074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1ac2d3cb-8387-482a-b176-ea67f4fa3df2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:44.355334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1ac2d3cb-8387-482a-b176-ea67f4fa3df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:44.448882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1194/2361] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:48:44.457217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd263-9f01-4c2d-8381-d0f8773dd256 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:44.457836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd263-9f01-4c2d-8381-d0f8773dd256 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:44.457836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbd263-9f01-4c2d-8381-d0f8773dd256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:44.484128 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-11dbd263-9f01-4c2d-8381-d0f8773dd256 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:44.486217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-11dbd263-9f01-4c2d-8381-d0f8773dd256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:44.514712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1168/2362] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:44.515792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2d3cb-8387-482a-b176-ea67f4fa3df2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:44.525296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:44.535107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2d3cb-8387-482a-b176-ea67f4fa3df2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:44.545018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fbc34-f286-40d3-9f2c-a2aa471362a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:44.546207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fbc34-f286-40d3-9f2c-a2aa471362a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:44.548529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fbc34-f286-40d3-9f2c-a2aa471362a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:44.552069 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fbc34-f286-40d3-9f2c-a2aa471362a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:44.552308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fbc34-f286-40d3-9f2c-a2aa471362a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:48:44.552628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fbc34-f286-40d3-9f2c-a2aa471362a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:44.554516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fbc34-f286-40d3-9f2c-a2aa471362a1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:44.578887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1195/2363] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:48:44.586631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbd263-9f01-4c2d-8381-d0f8773dd256 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:44.610908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbd263-9f01-4c2d-8381-d0f8773dd256 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:44.619640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed4164-2bc4-41ee-8b79-665cfe40f789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:44.620681 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4164-2bc4-41ee-8b79-665cfe40f789 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:44.621596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4164-2bc4-41ee-8b79-665cfe40f789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:44.622360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed4164-2bc4-41ee-8b79-665cfe40f789 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:44.623464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed4164-2bc4-41ee-8b79-665cfe40f789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:44.641870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed4164-2bc4-41ee-8b79-665cfe40f789 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:44.642225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fbc34-f286-40d3-9f2c-a2aa471362a1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:44.644404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f63fbc34-f286-40d3-9f2c-a2aa471362a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:44.663509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fbc34-f286-40d3-9f2c-a2aa471362a1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:44.674618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:44.676236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:44.676763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:44.677121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] PATH_INFO: `/v3/projects/4058bf566f0f48fdae56db3965ab0e62` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:44.679050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4058bf566f0f48fdae56db3965ab0e62)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:44.682667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:44.693486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1169/2364] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:44 2022] POST /identity/v3/projects => generated 405 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:44.697844 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed4164-2bc4-41ee-8b79-665cfe40f789 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:44.794772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4058bf566f0f48fdae56db3965ab0e62', 'request_id': 'req-6f046bd1-2f11-4538-b53c-fb41c5059bd1'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:44.805941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4058bf566f0f48fdae56db3965ab0e62', 'request_id': 'req-6f046bd1-2f11-4538-b53c-fb41c5059bd1'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:44.820796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4058bf566f0f48fdae56db3965ab0e62', 'request_id': 'req-6f046bd1-2f11-4538-b53c-fb41c5059bd1'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:44.842941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] The token cache is being invalidate because project 4058bf566f0f48fdae56db3965ab0e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:44.843548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:44.844489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:44.845172 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed4164-2bc4-41ee-8b79-665cfe40f789 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:44.854320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1196/2365] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:44 2022] DELETE /identity/v3/projects/4058bf566f0f48fdae56db3965ab0e62 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:44.856167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:44.858265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:44.961626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f046bd1-2f11-4538-b53c-fb41c5059bd1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:44.968443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:44.971167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:44.971530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49577-8eea-4002-8e95-1b8b693dce66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:44.971853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:44.972309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49577-8eea-4002-8e95-1b8b693dce66 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:44.972533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] PATH_INFO: `/v3/users/075bbf110ab54a568d86e97fb486958b` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:44.972778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49577-8eea-4002-8e95-1b8b693dce66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:44.973113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c49577-8eea-4002-8e95-1b8b693dce66 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:44.974917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=075bbf110ab54a568d86e97fb486958b)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:44.978618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:44.985983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c49577-8eea-4002-8e95-1b8b693dce66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:44.988886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c49577-8eea-4002-8e95-1b8b693dce66 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:45.042255 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1170/2366] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:44 2022] POST /identity/v3/users => generated 303 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:48:45.047652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49577-8eea-4002-8e95-1b8b693dce66 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:45.051181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-b4c49577-8eea-4002-8e95-1b8b693dce66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:45.066326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c49577-8eea-4002-8e95-1b8b693dce66 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:45.066621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075bbf110ab54a568d86e97fb486958b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:45.073716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ecaea-de82-4714-ac66-273dede489bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:45.074803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ecaea-de82-4714-ac66-273dede489bb admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:45.075409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ecaea-de82-4714-ac66-273dede489bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:45.076226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ecaea-de82-4714-ac66-273dede489bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:45.077283 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075bbf110ab54a568d86e97fb486958b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:45.077942 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ecaea-de82-4714-ac66-273dede489bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:45.078330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075bbf110ab54a568d86e97fb486958b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:45.081565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13ecaea-de82-4714-ac66-273dede489bb admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:45.095556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075bbf110ab54a568d86e97fb486958b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:45.098108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:45.101976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1171/2367] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:45.106360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ecaea-de82-4714-ac66-273dede489bb admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:45.111609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075bbf110ab54a568d86e97fb486958b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:45.119719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ecaea-de82-4714-ac66-273dede489bb admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:45.129735 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1197/2368] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:44 2022] DELETE /identity/v3/users/075bbf110ab54a568d86e97fb486958b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:45.137799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a883ce-001f-436f-8d18-d1fd3d98c510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:45.138862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a883ce-001f-436f-8d18-d1fd3d98c510 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:45.139263 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a883ce-001f-436f-8d18-d1fd3d98c510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:45.139686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a883ce-001f-436f-8d18-d1fd3d98c510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:45.140562 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a883ce-001f-436f-8d18-d1fd3d98c510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:45.142911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a883ce-001f-436f-8d18-d1fd3d98c510 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:45.179244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1172/2369] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:48:45.183401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:45.185020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:45.306671 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f9b3a-4c57-4a01-9850-971d8381ddf4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:45.324179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccc7a3-6401-4401-88e3-cdc317f8de47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:45.325103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccc7a3-6401-4401-88e3-cdc317f8de47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:45.325384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccc7a3-6401-4401-88e3-cdc317f8de47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:45.325659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ccc7a3-6401-4401-88e3-cdc317f8de47 admin admin] PATH_INFO: `/v3/projects/a43715243890431ea7fd289a05c89077/users/75110c5142ad424999e185b9877a6c9f/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:45.379492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccc7a3-6401-4401-88e3-cdc317f8de47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a43715243890431ea7fd289a05c89077, user_id=75110c5142ad424999e185b9877a6c9f, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:45.388204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ccc7a3-6401-4401-88e3-cdc317f8de47 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:45.432078 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1198/2370] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:45 2022] PUT /identity/v3/projects/a43715243890431ea7fd289a05c89077/users/75110c5142ad424999e185b9877a6c9f/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:45.433826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84ea39-4d80-46e0-86de-d71f1af9cf56 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:45.434121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84ea39-4d80-46e0-86de-d71f1af9cf56 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:45.434396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d84ea39-4d80-46e0-86de-d71f1af9cf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:45.448377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:45.501904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-0d84ea39-4d80-46e0-86de-d71f1af9cf56 None None] MFA Rules not processed for user `75110c5142ad424999e185b9877a6c9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:45.508026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0d84ea39-4d80-46e0-86de-d71f1af9cf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:45.639037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccc7a3-6401-4401-88e3-cdc317f8de47 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:45.639630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1173/2371] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:45.677171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84ea39-4d80-46e0-86de-d71f1af9cf56 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:45.678741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0d84ea39-4d80-46e0-86de-d71f1af9cf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:45.777125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ccc7a3-6401-4401-88e3-cdc317f8de47 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:45.782917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6d51b-99da-454a-bec0-909910eaff6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:45.783754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d51b-99da-454a-bec0-909910eaff6b admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:45.784046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d51b-99da-454a-bec0-909910eaff6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:45.784445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a6d51b-99da-454a-bec0-909910eaff6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:45.785158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6d51b-99da-454a-bec0-909910eaff6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:45.787178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a6d51b-99da-454a-bec0-909910eaff6b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:45.807855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d84ea39-4d80-46e0-86de-d71f1af9cf56 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:45.817571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:45.818589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:45.819036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:45.819352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] PATH_INFO: `/v3/projects/ffbd153bf2bc467197703292788ea529` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:45.821084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffbd153bf2bc467197703292788ea529)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:45.824060 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:45.836631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1199/2372] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:45 2022] POST /identity/v3/projects => generated 403 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:48:45.848627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6d51b-99da-454a-bec0-909910eaff6b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:45.915334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffbd153bf2bc467197703292788ea529', 'request_id': 'req-2d3b689c-56e1-48b5-8c50-7807a263cbf9'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:45.931343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffbd153bf2bc467197703292788ea529', 'request_id': 'req-2d3b689c-56e1-48b5-8c50-7807a263cbf9'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:45.945775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffbd153bf2bc467197703292788ea529', 'request_id': 'req-2d3b689c-56e1-48b5-8c50-7807a263cbf9'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:45.967591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] The token cache is being invalidate because project ffbd153bf2bc467197703292788ea529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:45.968324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:45.970155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2d3b689c-56e1-48b5-8c50-7807a263cbf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:45.972004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a6d51b-99da-454a-bec0-909910eaff6b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:45.977845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1174/2373] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:45 2022] DELETE /identity/v3/projects/ffbd153bf2bc467197703292788ea529 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:45.980065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:45.981563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928712c-fa1b-446e-b677-359d16135e4d None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:45.982063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928712c-fa1b-446e-b677-359d16135e4d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:45.982991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d928712c-fa1b-446e-b677-359d16135e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.026708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d928712c-fa1b-446e-b677-359d16135e4d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:46.028332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d928712c-fa1b-446e-b677-359d16135e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:46.083382 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:46.092819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92e007-c9f1-4dff-af05-b80c23516b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.093833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92e007-c9f1-4dff-af05-b80c23516b3c admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.095070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92e007-c9f1-4dff-af05-b80c23516b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.095070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a92e007-c9f1-4dff-af05-b80c23516b3c admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.095719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92e007-c9f1-4dff-af05-b80c23516b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:46.100470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a92e007-c9f1-4dff-af05-b80c23516b3c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:46.154528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1200/2374] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:45 2022] POST /identity/v3/users => generated 308 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:46.156410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92e007-c9f1-4dff-af05-b80c23516b3c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.159902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5a92e007-c9f1-4dff-af05-b80c23516b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:46.163177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1175/2375] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:46.175375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67d673-e197-4263-ac71-bfd97d0d02e8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.175945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67d673-e197-4263-ac71-bfd97d0d02e8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.176381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67d673-e197-4263-ac71-bfd97d0d02e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.184401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a92e007-c9f1-4dff-af05-b80c23516b3c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.191637 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c2869-faa3-4acf-9835-d3918c3445c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.192328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2869-faa3-4acf-9835-d3918c3445c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.192612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2869-faa3-4acf-9835-d3918c3445c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.193013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c2869-faa3-4acf-9835-d3918c3445c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.193859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c2869-faa3-4acf-9835-d3918c3445c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:46.195634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c2869-faa3-4acf-9835-d3918c3445c2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:46.213966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1201/2376] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:46.216429 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c2869-faa3-4acf-9835-d3918c3445c2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.234175 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c2869-faa3-4acf-9835-d3918c3445c2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.239189 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1a67d673-e197-4263-ac71-bfd97d0d02e8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:46.240426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1a67d673-e197-4263-ac71-bfd97d0d02e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:46.241876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f290205-74b6-4b02-bcc4-5b88c0afb495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.243021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f290205-74b6-4b02-bcc4-5b88c0afb495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.243513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f290205-74b6-4b02-bcc4-5b88c0afb495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.243993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f290205-74b6-4b02-bcc4-5b88c0afb495 admin admin] PATH_INFO: `/v3/projects/498bc8b9700c4cf68ba69561a3039a15/users/47562c21e1e046d8b4f2b7ed15104b7e/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.269257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f290205-74b6-4b02-bcc4-5b88c0afb495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498bc8b9700c4cf68ba69561a3039a15, user_id=47562c21e1e046d8b4f2b7ed15104b7e, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:46.275067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1176/2377] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:46.275292 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f290205-74b6-4b02-bcc4-5b88c0afb495 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:46.295827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67d673-e197-4263-ac71-bfd97d0d02e8 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.315036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1202/2378] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:46 2022] PUT /identity/v3/projects/498bc8b9700c4cf68ba69561a3039a15/users/47562c21e1e046d8b4f2b7ed15104b7e/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:46.317110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67d673-e197-4263-ac71-bfd97d0d02e8 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.318483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f290205-74b6-4b02-bcc4-5b88c0afb495 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.434290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f290205-74b6-4b02-bcc4-5b88c0afb495 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.439959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5a368-e2d8-4d67-a38e-4a3be6eddd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.441634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5a368-e2d8-4d67-a38e-4a3be6eddd9c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.441922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5a368-e2d8-4d67-a38e-4a3be6eddd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.442238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5a368-e2d8-4d67-a38e-4a3be6eddd9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.442983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5a368-e2d8-4d67-a38e-4a3be6eddd9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:46.444618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5a368-e2d8-4d67-a38e-4a3be6eddd9c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:46.456670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f031011-d655-4d16-b34f-70dd4aad3371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.459008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f031011-d655-4d16-b34f-70dd4aad3371 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.463576 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1203/2379] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:46.463771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f031011-d655-4d16-b34f-70dd4aad3371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.463771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f031011-d655-4d16-b34f-70dd4aad3371 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.464427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f031011-d655-4d16-b34f-70dd4aad3371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:48:46.464953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f031011-d655-4d16-b34f-70dd4aad3371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:46.467289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5a368-e2d8-4d67-a38e-4a3be6eddd9c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.469002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f031011-d655-4d16-b34f-70dd4aad3371 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:46.481997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5a368-e2d8-4d67-a38e-4a3be6eddd9c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.488499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1177/2380] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:48:46.493097 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f031011-d655-4d16-b34f-70dd4aad3371 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.494885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc71042-23f0-460d-b197-6978804b4f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.496173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc71042-23f0-460d-b197-6978804b4f4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.496751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc71042-23f0-460d-b197-6978804b4f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.497517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc71042-23f0-460d-b197-6978804b4f4d admin admin] PATH_INFO: `/v3/projects/498bc8b9700c4cf68ba69561a3039a15/users/47562c21e1e046d8b4f2b7ed15104b7e/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.500647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc71042-23f0-460d-b197-6978804b4f4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=498bc8b9700c4cf68ba69561a3039a15, user_id=47562c21e1e046d8b4f2b7ed15104b7e, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:46.504717 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc71042-23f0-460d-b197-6978804b4f4d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:46.528568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f031011-d655-4d16-b34f-70dd4aad3371 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.530144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1204/2381] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:46 2022] PUT /identity/v3/projects/498bc8b9700c4cf68ba69561a3039a15/users/47562c21e1e046d8b4f2b7ed15104b7e/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:46.532162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2c0b8-d180-4dcf-b77d-e3e83621e0be None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.532522 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2c0b8-d180-4dcf-b77d-e3e83621e0be None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.532833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2c0b8-d180-4dcf-b77d-e3e83621e0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.577234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8fb2c0b8-d180-4dcf-b77d-e3e83621e0be None None] MFA Rules not processed for user `47562c21e1e046d8b4f2b7ed15104b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:46.579377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8fb2c0b8-d180-4dcf-b77d-e3e83621e0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:46.629302 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:46.634716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a91d8f-600c-4311-ae20-f714a15b2d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.635323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91d8f-600c-4311-ae20-f714a15b2d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.635602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91d8f-600c-4311-ae20-f714a15b2d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.635878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91d8f-600c-4311-ae20-f714a15b2d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.636577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a91d8f-600c-4311-ae20-f714a15b2d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:46.638547 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a91d8f-600c-4311-ae20-f714a15b2d16 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:46.680591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1178/2382] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:46 2022] POST /identity/v3/projects => generated 389 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:46.683232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1205/2383] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:46.690698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a91d8f-600c-4311-ae20-f714a15b2d16 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.694158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2c0b8-d180-4dcf-b77d-e3e83621e0be None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.696100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8fb2c0b8-d180-4dcf-b77d-e3e83621e0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:46.766039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:46.799509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a91d8f-600c-4311-ae20-f714a15b2d16 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.805849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8f7af-a73e-4fd7-b0c8-683e9c25082f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.806653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8f7af-a73e-4fd7-b0c8-683e9c25082f admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.807008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8f7af-a73e-4fd7-b0c8-683e9c25082f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.807288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8f7af-a73e-4fd7-b0c8-683e9c25082f admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.808002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8f7af-a73e-4fd7-b0c8-683e9c25082f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:46.809366 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2c0b8-d180-4dcf-b77d-e3e83621e0be None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.810170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8f7af-a73e-4fd7-b0c8-683e9c25082f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:46.844665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1179/2384] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:46 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:46.849818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8f7af-a73e-4fd7-b0c8-683e9c25082f admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.871328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8f7af-a73e-4fd7-b0c8-683e9c25082f admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.878480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aba580-08eb-44d6-9381-c17c3fa9f81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.879364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aba580-08eb-44d6-9381-c17c3fa9f81c admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.879824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aba580-08eb-44d6-9381-c17c3fa9f81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.880284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aba580-08eb-44d6-9381-c17c3fa9f81c admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.881433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aba580-08eb-44d6-9381-c17c3fa9f81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:46.883762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aba580-08eb-44d6-9381-c17c3fa9f81c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:46.898912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1180/2385] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:48:46.900016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aba580-08eb-44d6-9381-c17c3fa9f81c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.910861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7db015-339d-4485-8bb7-3033387c48a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.911995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db015-339d-4485-8bb7-3033387c48a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.912531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db015-339d-4485-8bb7-3033387c48a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.913451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aba580-08eb-44d6-9381-c17c3fa9f81c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.915065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db015-339d-4485-8bb7-3033387c48a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.920449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee7c78-9428-4241-b90d-b4f3bbbe6d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.921146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee7c78-9428-4241-b90d-b4f3bbbe6d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.921587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee7c78-9428-4241-b90d-b4f3bbbe6d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.921871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee7c78-9428-4241-b90d-b4f3bbbe6d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:46.922651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee7c78-9428-4241-b90d-b4f3bbbe6d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:46.924567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee7c78-9428-4241-b90d-b4f3bbbe6d92 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:46.941406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1181/2386] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:46.943869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee7c78-9428-4241-b90d-b4f3bbbe6d92 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:46.956298 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee7c78-9428-4241-b90d-b4f3bbbe6d92 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:46.970597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7fdb9e-1897-4b7f-a114-f38e77c76754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:46.971511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fdb9e-1897-4b7f-a114-f38e77c76754 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:46.972349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fdb9e-1897-4b7f-a114-f38e77c76754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:46.972609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7fdb9e-1897-4b7f-a114-f38e77c76754 admin admin] PATH_INFO: `/v3/projects/75c2d832adec4d528d859553e0a2d02e/users/09b5d5f69c5849748a2211e4613fae2c/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:47.002860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fdb9e-1897-4b7f-a114-f38e77c76754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75c2d832adec4d528d859553e0a2d02e, user_id=09b5d5f69c5849748a2211e4613fae2c, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:47.008308 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7fdb9e-1897-4b7f-a114-f38e77c76754 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:47.022798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7db015-339d-4485-8bb7-3033387c48a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:47.024378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7db015-339d-4485-8bb7-3033387c48a3 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:47.030139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1182/2387] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:46 2022] PUT /identity/v3/projects/75c2d832adec4d528d859553e0a2d02e/users/09b5d5f69c5849748a2211e4613fae2c/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:47.042276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b9e5-9560-49ec-a5a7-e058e989d996 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:47.043109 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b9e5-9560-49ec-a5a7-e058e989d996 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:47.043827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b9e5-9560-49ec-a5a7-e058e989d996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:47.048784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1206/2388] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:48:47.103521 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-8577b9e5-9560-49ec-a5a7-e058e989d996 None None] MFA Rules not processed for user `09b5d5f69c5849748a2211e4613fae2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:47.104837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8577b9e5-9560-49ec-a5a7-e058e989d996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:47.234414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1183/2389] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:47.239154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7db015-339d-4485-8bb7-3033387c48a3 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:47.251629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7db015-339d-4485-8bb7-3033387c48a3 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:47.267014 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577b9e5-9560-49ec-a5a7-e058e989d996 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:47.336807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:47.375090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577b9e5-9560-49ec-a5a7-e058e989d996 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:47.385831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:47.387097 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:47.387538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:47.388424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] PATH_INFO: `/v3/users/75110c5142ad424999e185b9877a6c9f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:47.390197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] RBAC: Authorizing `identity:delete_user(user_id=75110c5142ad424999e185b9877a6c9f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:47.393185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:47.413022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:47.414149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff6498-3621-499e-986e-afca82097ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:47.414952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff6498-3621-499e-986e-afca82097ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:47.415478 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff6498-3621-499e-986e-afca82097ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:47.416395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff6498-3621-499e-986e-afca82097ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:47.417241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff6498-3621-499e-986e-afca82097ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:47.421495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff6498-3621-499e-986e-afca82097ce8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:47.489624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1207/2390] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:47 2022] POST /identity/v3/projects => generated 389 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:47.495776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff6498-3621-499e-986e-afca82097ce8 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:47.528797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75110c5142ad424999e185b9877a6c9f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:47.532692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75110c5142ad424999e185b9877a6c9f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:47.533605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75110c5142ad424999e185b9877a6c9f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:47.576554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75110c5142ad424999e185b9877a6c9f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:47.618413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c65867f5-6107-4eb7-af63-b078fc7695db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75110c5142ad424999e185b9877a6c9f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:47.658452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1184/2391] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:47 2022] DELETE /identity/v3/users/75110c5142ad424999e185b9877a6c9f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:47.660818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04643ab-1aee-4cf9-b876-c979a7cce699 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:47.660818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04643ab-1aee-4cf9-b876-c979a7cce699 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:47.661045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04643ab-1aee-4cf9-b876-c979a7cce699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:47.666035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff6498-3621-499e-986e-afca82097ce8 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:47.703526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a04643ab-1aee-4cf9-b876-c979a7cce699 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:47.705202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a04643ab-1aee-4cf9-b876-c979a7cce699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:47.777116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9fb45-39f2-4da9-b411-bc41e31dc7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:47.778056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9fb45-39f2-4da9-b411-bc41e31dc7cb admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:47.779423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9fb45-39f2-4da9-b411-bc41e31dc7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:47.779856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9fb45-39f2-4da9-b411-bc41e31dc7cb admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:47.780714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9fb45-39f2-4da9-b411-bc41e31dc7cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:47.783294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9fb45-39f2-4da9-b411-bc41e31dc7cb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:47.829895 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1208/2392] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:47 2022] POST /identity/v3/users => generated 301 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:47.835199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9fb45-39f2-4da9-b411-bc41e31dc7cb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:47.837997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3af9fb45-39f2-4da9-b411-bc41e31dc7cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:47.864439 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9fb45-39f2-4da9-b411-bc41e31dc7cb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:47.874999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe30853-7f21-4587-95cb-a66169c4035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:47.875847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe30853-7f21-4587-95cb-a66169c4035b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:47.878269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe30853-7f21-4587-95cb-a66169c4035b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:47.879871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1185/2393] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:47.890385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe30853-7f21-4587-95cb-a66169c4035b admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:47.893552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04643ab-1aee-4cf9-b876-c979a7cce699 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:47.895782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe30853-7f21-4587-95cb-a66169c4035b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:47.896557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a04643ab-1aee-4cf9-b876-c979a7cce699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:47.901703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe30853-7f21-4587-95cb-a66169c4035b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:47.928650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1209/2394] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:47.933150 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe30853-7f21-4587-95cb-a66169c4035b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:47.947494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe30853-7f21-4587-95cb-a66169c4035b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:47.954400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2b453-0a30-48df-94fe-a20ec3ee5ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:47.955428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b453-0a30-48df-94fe-a20ec3ee5ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:47.955781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b453-0a30-48df-94fe-a20ec3ee5ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:47.956215 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2b453-0a30-48df-94fe-a20ec3ee5ccc admin admin] PATH_INFO: `/v3/projects/51db0ea8b1624dc7978544216838b8c7/users/37f721e73f744284a3c118b653a0cca5/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:47.979294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2b453-0a30-48df-94fe-a20ec3ee5ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=51db0ea8b1624dc7978544216838b8c7, user_id=37f721e73f744284a3c118b653a0cca5, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:47.982627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2b453-0a30-48df-94fe-a20ec3ee5ccc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:48.038447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1210/2395] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:47 2022] PUT /identity/v3/projects/51db0ea8b1624dc7978544216838b8c7/users/37f721e73f744284a3c118b653a0cca5/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:48.039461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2b453-0a30-48df-94fe-a20ec3ee5ccc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:48.046754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04643ab-1aee-4cf9-b876-c979a7cce699 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:48.108237 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:48.171919 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:48.187831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31290559-ba19-4572-9e7c-723964c953cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:48.188648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290559-ba19-4572-9e7c-723964c953cd service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:48.188940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290559-ba19-4572-9e7c-723964c953cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:48.189353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31290559-ba19-4572-9e7c-723964c953cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:48.233975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2b453-0a30-48df-94fe-a20ec3ee5ccc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:48.251878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a75572-3d44-4c8a-8351-73333a4c63a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:48.252680 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a75572-3d44-4c8a-8351-73333a4c63a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:48.252995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a75572-3d44-4c8a-8351-73333a4c63a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:48.253445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a75572-3d44-4c8a-8351-73333a4c63a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:48.254456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a75572-3d44-4c8a-8351-73333a4c63a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:48.257163 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a75572-3d44-4c8a-8351-73333a4c63a1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:48.289140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1211/2396] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:48.293972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290559-ba19-4572-9e7c-723964c953cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:48.294267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a75572-3d44-4c8a-8351-73333a4c63a1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:48.295698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31290559-ba19-4572-9e7c-723964c953cd service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:48.310251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a75572-3d44-4c8a-8351-73333a4c63a1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:48.320033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73c96f-67e6-4fef-8d51-f12b2f34ac85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:48.322886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1186/2397] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:48.323238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73c96f-67e6-4fef-8d51-f12b2f34ac85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:48.323606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73c96f-67e6-4fef-8d51-f12b2f34ac85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:48.323958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73c96f-67e6-4fef-8d51-f12b2f34ac85 admin admin] PATH_INFO: `/v3/projects/51db0ea8b1624dc7978544216838b8c7/users/37f721e73f744284a3c118b653a0cca5/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:48.357064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73c96f-67e6-4fef-8d51-f12b2f34ac85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51db0ea8b1624dc7978544216838b8c7, user_id=37f721e73f744284a3c118b653a0cca5, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:48.360063 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73c96f-67e6-4fef-8d51-f12b2f34ac85 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:48.394788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1212/2398] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:48 2022] PUT /identity/v3/projects/51db0ea8b1624dc7978544216838b8c7/users/37f721e73f744284a3c118b653a0cca5/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:48.402120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4593a-897b-4e5e-a3e4-c6f1ef437cfd None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:48.402514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4593a-897b-4e5e-a3e4-c6f1ef437cfd None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:48.402809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4593a-897b-4e5e-a3e4-c6f1ef437cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:48.462138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-aae4593a-897b-4e5e-a3e4-c6f1ef437cfd None None] MFA Rules not processed for user `37f721e73f744284a3c118b653a0cca5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:48.463426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-aae4593a-897b-4e5e-a3e4-c6f1ef437cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:48.611714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1187/2399] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:48:48.626402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73c96f-67e6-4fef-8d51-f12b2f34ac85 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:48.629028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bb73c96f-67e6-4fef-8d51-f12b2f34ac85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:48.736374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73c96f-67e6-4fef-8d51-f12b2f34ac85 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:48.746510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0a22d-69ba-4a29-8218-0bd86160e086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:48.747092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0a22d-69ba-4a29-8218-0bd86160e086 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:48.747390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0a22d-69ba-4a29-8218-0bd86160e086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:48.747683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0a22d-69ba-4a29-8218-0bd86160e086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:48.763197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0a22d-69ba-4a29-8218-0bd86160e086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:48.765799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0a22d-69ba-4a29-8218-0bd86160e086 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:48.781453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1213/2400] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:49.043232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4593a-897b-4e5e-a3e4-c6f1ef437cfd None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:49.088606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0a22d-69ba-4a29-8218-0bd86160e086 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:49.090527 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-49d0a22d-69ba-4a29-8218-0bd86160e086 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:49.194863 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4593a-897b-4e5e-a3e4-c6f1ef437cfd None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:49.200437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:49.201904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:49.202640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:49.203242 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] PATH_INFO: `/v3/users/09b5d5f69c5849748a2211e4613fae2c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:49.205426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b5d5f69c5849748a2211e4613fae2c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:49.209160 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:49.269073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0a22d-69ba-4a29-8218-0bd86160e086 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:49.270347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:49.278965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:49.280724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:49.281203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:49.281582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] PATH_INFO: `/v3/projects/a43715243890431ea7fd289a05c89077` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:49.283312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a43715243890431ea7fd289a05c89077)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:49.286399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:49.324654 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b5d5f69c5849748a2211e4613fae2c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.325370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b5d5f69c5849748a2211e4613fae2c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.326333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b5d5f69c5849748a2211e4613fae2c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.345217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b5d5f69c5849748a2211e4613fae2c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.357040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-5881c59e-cabb-40ee-bf2e-57d18f66ae62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b5d5f69c5849748a2211e4613fae2c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.387640 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1188/2401] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:49 2022] DELETE /identity/v3/users/09b5d5f69c5849748a2211e4613fae2c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:49.389549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a43715243890431ea7fd289a05c89077', 'request_id': 'req-4f924d52-8d20-4ce6-a91b-1d61629bb96f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.393436 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:49.396106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacf53f-560b-41d5-a5b2-3332ffb14b33 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:49.396106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacf53f-560b-41d5-a5b2-3332ffb14b33 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:49.396454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cacf53f-560b-41d5-a5b2-3332ffb14b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:49.417021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a43715243890431ea7fd289a05c89077', 'request_id': 'req-4f924d52-8d20-4ce6-a91b-1d61629bb96f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.433877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9cacf53f-560b-41d5-a5b2-3332ffb14b33 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:49.447629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9cacf53f-560b-41d5-a5b2-3332ffb14b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:49.448580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a43715243890431ea7fd289a05c89077', 'request_id': 'req-4f924d52-8d20-4ce6-a91b-1d61629bb96f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.468192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] The token cache is being invalidate because project a43715243890431ea7fd289a05c89077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:49.468462 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.469225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.475074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1214/2402] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:49 2022] DELETE /identity/v3/projects/a43715243890431ea7fd289a05c89077 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:49.476134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:49.478013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:49.545086 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1189/2403] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:49.557135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacf53f-560b-41d5-a5b2-3332ffb14b33 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:49.559526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9cacf53f-560b-41d5-a5b2-3332ffb14b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:49.598622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f924d52-8d20-4ce6-a91b-1d61629bb96f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:49.607990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:49.609057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:49.609411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:49.609690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] PATH_INFO: `/v3/users/47562c21e1e046d8b4f2b7ed15104b7e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:49.615600 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] RBAC: Authorizing `identity:delete_user(user_id=47562c21e1e046d8b4f2b7ed15104b7e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:49.617617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:49.653319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cacf53f-560b-41d5-a5b2-3332ffb14b33 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:49.664093 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517e62-687a-45fe-a2c6-e2e952818644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:49.667712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517e62-687a-45fe-a2c6-e2e952818644 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:49.669132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517e62-687a-45fe-a2c6-e2e952818644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:49.669883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54517e62-687a-45fe-a2c6-e2e952818644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:49.693826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54517e62-687a-45fe-a2c6-e2e952818644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:49.697683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54517e62-687a-45fe-a2c6-e2e952818644 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:49.751658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1190/2404] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:49.757295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47562c21e1e046d8b4f2b7ed15104b7e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.771408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47562c21e1e046d8b4f2b7ed15104b7e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.772179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47562c21e1e046d8b4f2b7ed15104b7e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.789672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47562c21e1e046d8b4f2b7ed15104b7e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.803932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47562c21e1e046d8b4f2b7ed15104b7e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:49.810998 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1215/2405] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:49 2022] DELETE /identity/v3/users/47562c21e1e046d8b4f2b7ed15104b7e => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:50.368589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517e62-687a-45fe-a2c6-e2e952818644 service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:50.394651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54517e62-687a-45fe-a2c6-e2e952818644 service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:50.498809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:50.539029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:50.541114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:50.541412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:50.541693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] PATH_INFO: `/v3/projects/498bc8b9700c4cf68ba69561a3039a15` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:50.544512 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498bc8b9700c4cf68ba69561a3039a15)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:50.548022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:50.641263 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498bc8b9700c4cf68ba69561a3039a15', 'request_id': 'req-8c26cb69-54ba-46fb-9d90-1c4483fd3050'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:50.662031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498bc8b9700c4cf68ba69561a3039a15', 'request_id': 'req-8c26cb69-54ba-46fb-9d90-1c4483fd3050'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:50.682076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498bc8b9700c4cf68ba69561a3039a15', 'request_id': 'req-8c26cb69-54ba-46fb-9d90-1c4483fd3050'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:50.705269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:50.709159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:50.716365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] The token cache is being invalidate because project 498bc8b9700c4cf68ba69561a3039a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:50.716763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:50.717525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8c26cb69-54ba-46fb-9d90-1c4483fd3050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:50.723321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1191/2406] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:50 2022] DELETE /identity/v3/projects/498bc8b9700c4cf68ba69561a3039a15 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:50.725012 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18fe0d-39ab-4ed8-8a6e-9e41e4adb9a1 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:50.725306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18fe0d-39ab-4ed8-8a6e-9e41e4adb9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:50.725584 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18fe0d-39ab-4ed8-8a6e-9e41e4adb9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:50.776990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea2b2f9-b83b-43d1-a1ad-33791362451c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:50.777516 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-df18fe0d-39ab-4ed8-8a6e-9e41e4adb9a1 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:50.780566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-df18fe0d-39ab-4ed8-8a6e-9e41e4adb9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:50.865896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:50.879158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:50.881350 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:50.882684 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:50.883287 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] PATH_INFO: `/v3/projects/75c2d832adec4d528d859553e0a2d02e` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:50.885791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75c2d832adec4d528d859553e0a2d02e)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:50.890643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:50.923040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1192/2407] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:50.925999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb031f-99be-4677-a348-668169080621 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:50.926462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb031f-99be-4677-a348-668169080621 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:50.926785 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb031f-99be-4677-a348-668169080621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:50.964692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-56bb031f-99be-4677-a348-668169080621 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:50.969649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-56bb031f-99be-4677-a348-668169080621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:50.971091 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75c2d832adec4d528d859553e0a2d02e', 'request_id': 'req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:50.986353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75c2d832adec4d528d859553e0a2d02e', 'request_id': 'req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:51.005415 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75c2d832adec4d528d859553e0a2d02e', 'request_id': 'req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:51.021917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] The token cache is being invalidate because project 75c2d832adec4d528d859553e0a2d02e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:51.022743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:51.023632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:51.028348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1216/2408] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:50 2022] DELETE /identity/v3/projects/75c2d832adec4d528d859553e0a2d02e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:51.029775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:51.031267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:51.106835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1193/2409] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:51.110130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb031f-99be-4677-a348-668169080621 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:51.125198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb031f-99be-4677-a348-668169080621 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:51.131313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca966f2-3a1e-499d-ad28-0672e5e990e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:51.132079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca966f2-3a1e-499d-ad28-0672e5e990e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:51.132516 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca966f2-3a1e-499d-ad28-0672e5e990e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:51.132857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca966f2-3a1e-499d-ad28-0672e5e990e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:51.133853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca966f2-3a1e-499d-ad28-0672e5e990e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:48:51.134498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca966f2-3a1e-499d-ad28-0672e5e990e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:51.136858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca966f2-3a1e-499d-ad28-0672e5e990e4 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:51.154426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1194/2410] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:48:51.158681 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca966f2-3a1e-499d-ad28-0672e5e990e4 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:51.164196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:51.169064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7c8b-1d54-46bb-8819-bf6f0de3ee93 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:51.175617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca966f2-3a1e-499d-ad28-0672e5e990e4 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:51.177671 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:51.179025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:51.179453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:51.179798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] PATH_INFO: `/v3/users/37f721e73f744284a3c118b653a0cca5` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:51.183727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce35f-3b62-4948-a74b-d3a5927fe222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:51.185030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce35f-3b62-4948-a74b-d3a5927fe222 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:51.185519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce35f-3b62-4948-a74b-d3a5927fe222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:51.185901 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ce35f-3b62-4948-a74b-d3a5927fe222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:51.189048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ce35f-3b62-4948-a74b-d3a5927fe222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:51.191236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f721e73f744284a3c118b653a0cca5)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:51.194124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ce35f-3b62-4948-a74b-d3a5927fe222 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:51.197966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:51.245033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1195/2411] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:51 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:51.247134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce35f-3b62-4948-a74b-d3a5927fe222 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:51.294742 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f721e73f744284a3c118b653a0cca5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:51.317515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f721e73f744284a3c118b653a0cca5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:51.319498 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f721e73f744284a3c118b653a0cca5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:51.352286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f721e73f744284a3c118b653a0cca5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:51.366161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ce35f-3b62-4948-a74b-d3a5927fe222 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:51.370578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f721e73f744284a3c118b653a0cca5'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:51.371430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ac6e2-3009-45b2-8a8e-7c9a9782c918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:51.372598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac6e2-3009-45b2-8a8e-7c9a9782c918 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:51.372889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac6e2-3009-45b2-8a8e-7c9a9782c918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:51.373169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ac6e2-3009-45b2-8a8e-7c9a9782c918 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:51.374202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ac6e2-3009-45b2-8a8e-7c9a9782c918 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:51.376255 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ac6e2-3009-45b2-8a8e-7c9a9782c918 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:51.390237 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1217/2412] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:48:51 2022] DELETE /identity/v3/users/37f721e73f744284a3c118b653a0cca5 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:51.413136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1196/2413] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:51 2022] POST /identity/v3/users => generated 290 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:51.416555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:51.418031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:51.432796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:51.553817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e24f32-98f6-4ec2-827c-030fb2438a9d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:51.563396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac3426-f748-4f63-8be3-5121fc301133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:51.564722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac3426-f748-4f63-8be3-5121fc301133 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:51.565306 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac3426-f748-4f63-8be3-5121fc301133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:51.565808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ac3426-f748-4f63-8be3-5121fc301133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:51.567207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac3426-f748-4f63-8be3-5121fc301133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:51.570440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ac3426-f748-4f63-8be3-5121fc301133 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:51.584631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1218/2414] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:51.590783 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ac6e2-3009-45b2-8a8e-7c9a9782c918 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:51.615670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ac6e2-3009-45b2-8a8e-7c9a9782c918 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:51.624078 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cda5d-c5f0-4855-8a7a-7439a5c09a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:51.625405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cda5d-c5f0-4855-8a7a-7439a5c09a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:51.626138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cda5d-c5f0-4855-8a7a-7439a5c09a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:51.626931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cda5d-c5f0-4855-8a7a-7439a5c09a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:51.628076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cda5d-c5f0-4855-8a7a-7439a5c09a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:51.631441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cda5d-c5f0-4855-8a7a-7439a5c09a0b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:51.646543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1197/2415] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:51.650550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac3426-f748-4f63-8be3-5121fc301133 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:51.673075 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ac3426-f748-4f63-8be3-5121fc301133 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:51.698268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012670c0-db2f-49ae-bb28-7f774045ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:51.700732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012670c0-db2f-49ae-bb28-7f774045ca3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:51.701670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012670c0-db2f-49ae-bb28-7f774045ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:51.702900 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012670c0-db2f-49ae-bb28-7f774045ca3b admin admin] PATH_INFO: `/v3/projects/6ed0717a52ca4eaba5b042c9bb60acdc/users/526fd9a388014b4d9b1e96970fc5d130/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:51.741700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012670c0-db2f-49ae-bb28-7f774045ca3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed0717a52ca4eaba5b042c9bb60acdc, user_id=526fd9a388014b4d9b1e96970fc5d130, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:51.744970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012670c0-db2f-49ae-bb28-7f774045ca3b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:51.773320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1219/2416] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:51 2022] PUT /identity/v3/projects/6ed0717a52ca4eaba5b042c9bb60acdc/users/526fd9a388014b4d9b1e96970fc5d130/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:51.784630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310241-73c4-4562-a37a-be8506adaf08 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:51.785191 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310241-73c4-4562-a37a-be8506adaf08 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:51.785191 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0310241-73c4-4562-a37a-be8506adaf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:51.852445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e0310241-73c4-4562-a37a-be8506adaf08 None None] MFA Rules not processed for user `526fd9a388014b4d9b1e96970fc5d130`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:51.854065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e0310241-73c4-4562-a37a-be8506adaf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:51.942827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012670c0-db2f-49ae-bb28-7f774045ca3b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:51.945575 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-012670c0-db2f-49ae-bb28-7f774045ca3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:52.036098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1198/2417] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:52.039096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310241-73c4-4562-a37a-be8506adaf08 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:52.088826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012670c0-db2f-49ae-bb28-7f774045ca3b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.100065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.101154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.101541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.102140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] PATH_INFO: `/v3/projects/51db0ea8b1624dc7978544216838b8c7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.104905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=51db0ea8b1624dc7978544216838b8c7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.107226 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.133634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:52.171118 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0310241-73c4-4562-a37a-be8506adaf08 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.177667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe58a-cafa-487c-ba4c-bc299e1e2ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.179412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe58a-cafa-487c-ba4c-bc299e1e2ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.179961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe58a-cafa-487c-ba4c-bc299e1e2ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.180433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe58a-cafa-487c-ba4c-bc299e1e2ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.181616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abe58a-cafa-487c-ba4c-bc299e1e2ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.184039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08abe58a-cafa-487c-ba4c-bc299e1e2ac3 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.206826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51db0ea8b1624dc7978544216838b8c7', 'request_id': 'req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:52.220516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51db0ea8b1624dc7978544216838b8c7', 'request_id': 'req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:52.230709 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51db0ea8b1624dc7978544216838b8c7', 'request_id': 'req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:52.242266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1199/2418] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:52 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:48:52.245069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe58a-cafa-487c-ba4c-bc299e1e2ac3 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:52.250243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] The token cache is being invalidate because project 51db0ea8b1624dc7978544216838b8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:48:52.250782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:52.252621 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4306f5ec-fb06-4dd3-91f8-c258ed620ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:48:52.257973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1220/2419] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:48:51 2022] DELETE /identity/v3/projects/51db0ea8b1624dc7978544216838b8c7 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:52.260045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f98ebf-590b-4b4d-abb5-3b06c86fa04f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.260388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f98ebf-590b-4b4d-abb5-3b06c86fa04f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.267254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f98ebf-590b-4b4d-abb5-3b06c86fa04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.295269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-47f98ebf-590b-4b4d-abb5-3b06c86fa04f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:52.296888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-47f98ebf-590b-4b4d-abb5-3b06c86fa04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:52.302540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:52.343793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe58a-cafa-487c-ba4c-bc299e1e2ac3 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.352559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716e640-093e-405e-bedb-f88feb0044f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.353923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e640-093e-405e-bedb-f88feb0044f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.354416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e640-093e-405e-bedb-f88feb0044f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.354839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716e640-093e-405e-bedb-f88feb0044f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.356041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716e640-093e-405e-bedb-f88feb0044f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.360196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9716e640-093e-405e-bedb-f88feb0044f2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.395119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1221/2420] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:52.395328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1200/2421] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:52 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:52.397311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716e640-093e-405e-bedb-f88feb0044f2 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:52.399650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51023f1-8462-4504-860e-1a74a64e8545 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.400389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9716e640-093e-405e-bedb-f88feb0044f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:52.400815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51023f1-8462-4504-860e-1a74a64e8545 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.401427 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51023f1-8462-4504-860e-1a74a64e8545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.421204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716e640-093e-405e-bedb-f88feb0044f2 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.429653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268b0f0-4996-471b-b479-877dd1352479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.430070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c51023f1-8462-4504-860e-1a74a64e8545 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:52.430645 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b0f0-4996-471b-b479-877dd1352479 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.430916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b0f0-4996-471b-b479-877dd1352479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.431301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268b0f0-4996-471b-b479-877dd1352479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.431467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c51023f1-8462-4504-860e-1a74a64e8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:52.432158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268b0f0-4996-471b-b479-877dd1352479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.433929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268b0f0-4996-471b-b479-877dd1352479 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.447907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1222/2422] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:52.448205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1201/2423] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:52.451163 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51023f1-8462-4504-860e-1a74a64e8545 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:52.451394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268b0f0-4996-471b-b479-877dd1352479 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:52.465787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268b0f0-4996-471b-b479-877dd1352479 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.466139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51023f1-8462-4504-860e-1a74a64e8545 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.472284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597581-b9ec-4589-b57e-4323480f5fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.472894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfadff-793b-4a5d-bcf2-42c78109080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.473085 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597581-b9ec-4589-b57e-4323480f5fe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.473255 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597581-b9ec-4589-b57e-4323480f5fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.473589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597581-b9ec-4589-b57e-4323480f5fe2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.473853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfadff-793b-4a5d-bcf2-42c78109080c admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.474124 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfadff-793b-4a5d-bcf2-42c78109080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.474373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a597581-b9ec-4589-b57e-4323480f5fe2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:48:52.475490 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bfadff-793b-4a5d-bcf2-42c78109080c admin admin] PATH_INFO: `/v3/projects/6e8b6273101c44dcbde96e3dc4841198/users/4ff758766af14d94b467070be21cfd43/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.475785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a597581-b9ec-4589-b57e-4323480f5fe2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.476490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a597581-b9ec-4589-b57e-4323480f5fe2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.506662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1223/2424] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:48:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:48:52.513575 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597581-b9ec-4589-b57e-4323480f5fe2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:52.521383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfadff-793b-4a5d-bcf2-42c78109080c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8b6273101c44dcbde96e3dc4841198, user_id=4ff758766af14d94b467070be21cfd43, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.524226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bfadff-793b-4a5d-bcf2-42c78109080c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.531833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597581-b9ec-4589-b57e-4323480f5fe2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.539805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a27a4-acf7-485b-8672-2b2e2eea1a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.540021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a27a4-acf7-485b-8672-2b2e2eea1a82 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.540378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a27a4-acf7-485b-8672-2b2e2eea1a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.540883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a27a4-acf7-485b-8672-2b2e2eea1a82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.541854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a27a4-acf7-485b-8672-2b2e2eea1a82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.549037 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a27a4-acf7-485b-8672-2b2e2eea1a82 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.557890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1202/2425] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:52 2022] PUT /identity/v3/projects/6e8b6273101c44dcbde96e3dc4841198/users/4ff758766af14d94b467070be21cfd43/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:52.562766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfadff-793b-4a5d-bcf2-42c78109080c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:52.595755 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1224/2426] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:52 2022] POST /identity/v3/projects => generated 373 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:52.597286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a27a4-acf7-485b-8672-2b2e2eea1a82 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:52.669406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bfadff-793b-4a5d-bcf2-42c78109080c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.717689 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:52.751343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797a721-5203-45bf-9db7-09f0be6c97c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.752258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797a721-5203-45bf-9db7-09f0be6c97c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.753370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797a721-5203-45bf-9db7-09f0be6c97c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.753722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c797a721-5203-45bf-9db7-09f0be6c97c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.754691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797a721-5203-45bf-9db7-09f0be6c97c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.756823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c797a721-5203-45bf-9db7-09f0be6c97c3 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.771148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a27a4-acf7-485b-8672-2b2e2eea1a82 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.772024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1203/2427] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:52.777488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797a721-5203-45bf-9db7-09f0be6c97c3 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:52.789701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7977a6-e9ca-4720-930c-35df1f5b32b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.790410 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7977a6-e9ca-4720-930c-35df1f5b32b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.790696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7977a6-e9ca-4720-930c-35df1f5b32b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.790975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7977a6-e9ca-4720-930c-35df1f5b32b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.791732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7977a6-e9ca-4720-930c-35df1f5b32b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.791893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c797a721-5203-45bf-9db7-09f0be6c97c3 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.793922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7977a6-e9ca-4720-930c-35df1f5b32b7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.797253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2841a-7781-4386-885f-0637fcdc8bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.798440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2841a-7781-4386-885f-0637fcdc8bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.798805 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2841a-7781-4386-885f-0637fcdc8bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.799972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2841a-7781-4386-885f-0637fcdc8bdd admin admin] PATH_INFO: `/v3/projects/6e8b6273101c44dcbde96e3dc4841198/users/4ff758766af14d94b467070be21cfd43/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.802935 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2841a-7781-4386-885f-0637fcdc8bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8b6273101c44dcbde96e3dc4841198, user_id=4ff758766af14d94b467070be21cfd43, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.806314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2841a-7781-4386-885f-0637fcdc8bdd admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.834719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1204/2428] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:52 2022] PUT /identity/v3/projects/6e8b6273101c44dcbde96e3dc4841198/users/4ff758766af14d94b467070be21cfd43/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:48:52.838129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b31ae8-313c-417b-90f1-ed1f899561d8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.838544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b31ae8-313c-417b-90f1-ed1f899561d8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.838917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b31ae8-313c-417b-90f1-ed1f899561d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.844273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1225/2429] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:52 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:52.845065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7977a6-e9ca-4720-930c-35df1f5b32b7 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:52.856647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7977a6-e9ca-4720-930c-35df1f5b32b7 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:52.929811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-85b31ae8-313c-417b-90f1-ed1f899561d8 None None] MFA Rules not processed for user `4ff758766af14d94b467070be21cfd43`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:52.931196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-85b31ae8-313c-417b-90f1-ed1f899561d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:52.943653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:52.951804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d90ec-4840-4bec-bbb9-a29dfc904682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:52.952558 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d90ec-4840-4bec-bbb9-a29dfc904682 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:52.952869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d90ec-4840-4bec-bbb9-a29dfc904682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:52.953144 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d90ec-4840-4bec-bbb9-a29dfc904682 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:52.953879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d90ec-4840-4bec-bbb9-a29dfc904682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:52.961304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d90ec-4840-4bec-bbb9-a29dfc904682 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:52.983022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1226/2430] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:52.991823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d90ec-4840-4bec-bbb9-a29dfc904682 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:53.020314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d90ec-4840-4bec-bbb9-a29dfc904682 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:53.035060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1182-0956-43d6-9b03-2b00d76e428b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:53.036659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1182-0956-43d6-9b03-2b00d76e428b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:53.037439 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1182-0956-43d6-9b03-2b00d76e428b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:53.038222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a1182-0956-43d6-9b03-2b00d76e428b admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:53.039874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1182-0956-43d6-9b03-2b00d76e428b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:53.041817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618a1182-0956-43d6-9b03-2b00d76e428b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:53.061906 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1227/2431] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:53.063532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1182-0956-43d6-9b03-2b00d76e428b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:53.079506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a1182-0956-43d6-9b03-2b00d76e428b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:53.091782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db58323-e9d5-4fec-8a4c-93b4f9c1f529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:53.093155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db58323-e9d5-4fec-8a4c-93b4f9c1f529 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:53.094547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db58323-e9d5-4fec-8a4c-93b4f9c1f529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:53.094547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db58323-e9d5-4fec-8a4c-93b4f9c1f529 admin admin] PATH_INFO: `/v3/projects/16a7b422e1774940af4ef7aa70079321/users/afbd8db46add416e8b9b32e64e9393e2/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:53.114756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1205/2432] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:53.127214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db58323-e9d5-4fec-8a4c-93b4f9c1f529 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16a7b422e1774940af4ef7aa70079321, user_id=afbd8db46add416e8b9b32e64e9393e2, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:53.131408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db58323-e9d5-4fec-8a4c-93b4f9c1f529 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:53.152851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b31ae8-313c-417b-90f1-ed1f899561d8 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:53.157567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-85b31ae8-313c-417b-90f1-ed1f899561d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:53.167901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1228/2433] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:53 2022] PUT /identity/v3/projects/16a7b422e1774940af4ef7aa70079321/users/afbd8db46add416e8b9b32e64e9393e2/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:53.175905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1e4b0-a40f-4d9b-8577-c1e3815e46a3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:53.177743 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1e4b0-a40f-4d9b-8577-c1e3815e46a3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:53.179172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d1e4b0-a40f-4d9b-8577-c1e3815e46a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:53.218812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c7d1e4b0-a40f-4d9b-8577-c1e3815e46a3 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:53.222423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c7d1e4b0-a40f-4d9b-8577-c1e3815e46a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:53.266877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b31ae8-313c-417b-90f1-ed1f899561d8 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:53.323839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1229/2434] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:53.330127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40630d-eb3e-45fc-a8fe-19ca67d58051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:53.333093 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40630d-eb3e-45fc-a8fe-19ca67d58051 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:53.333585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40630d-eb3e-45fc-a8fe-19ca67d58051 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:53.334046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e40630d-eb3e-45fc-a8fe-19ca67d58051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:53.338711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1e4b0-a40f-4d9b-8577-c1e3815e46a3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:53.340483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c7d1e4b0-a40f-4d9b-8577-c1e3815e46a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:53.360119 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:53.460775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40630d-eb3e-45fc-a8fe-19ca67d58051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:53.462432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e40630d-eb3e-45fc-a8fe-19ca67d58051 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:53.486274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1206/2435] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:53.508081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d1e4b0-a40f-4d9b-8577-c1e3815e46a3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:53.513093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d45b5e-b175-408d-af7f-d3eca58aa443 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:53.513932 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d45b5e-b175-408d-af7f-d3eca58aa443 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:53.514323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d45b5e-b175-408d-af7f-d3eca58aa443 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:53.514707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d45b5e-b175-408d-af7f-d3eca58aa443 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:53.530638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d45b5e-b175-408d-af7f-d3eca58aa443 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:53.532121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d45b5e-b175-408d-af7f-d3eca58aa443 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:53.562544 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1230/2436] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:53.606936 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40630d-eb3e-45fc-a8fe-19ca67d58051 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:53.628605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e40630d-eb3e-45fc-a8fe-19ca67d58051 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:53.634924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dd1d4-1a8e-4f49-8b13-9b479a6b5422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:53.635877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dd1d4-1a8e-4f49-8b13-9b479a6b5422 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:53.636405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dd1d4-1a8e-4f49-8b13-9b479a6b5422 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:53.636836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450dd1d4-1a8e-4f49-8b13-9b479a6b5422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:53.640186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-450dd1d4-1a8e-4f49-8b13-9b479a6b5422 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:53.764258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450dd1d4-1a8e-4f49-8b13-9b479a6b5422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:53.766000 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450dd1d4-1a8e-4f49-8b13-9b479a6b5422 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:53.794116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1207/2437] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:48:54.590509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952ed5d-721b-4214-9a2f-401f6a66d8a2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:54.591523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952ed5d-721b-4214-9a2f-401f6a66d8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:54.591976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952ed5d-721b-4214-9a2f-401f6a66d8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:54.672101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-6952ed5d-721b-4214-9a2f-401f6a66d8a2 None None] MFA Rules not processed for user `afbd8db46add416e8b9b32e64e9393e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:54.673320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6952ed5d-721b-4214-9a2f-401f6a66d8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:54.775734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:54.831082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1231/2438] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:54.838211 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dd1d4-1a8e-4f49-8b13-9b479a6b5422 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:54.851529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450dd1d4-1a8e-4f49-8b13-9b479a6b5422 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:54.866861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359ac81-2dfe-4067-bc2d-4568f22b95a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:54.867433 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359ac81-2dfe-4067-bc2d-4568f22b95a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:54.868579 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359ac81-2dfe-4067-bc2d-4568f22b95a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:54.868871 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359ac81-2dfe-4067-bc2d-4568f22b95a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:54.870598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359ac81-2dfe-4067-bc2d-4568f22b95a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:54.874029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359ac81-2dfe-4067-bc2d-4568f22b95a6 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:54.913200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1208/2439] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:48:54 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:48:54.916894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952ed5d-721b-4214-9a2f-401f6a66d8a2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:54.929038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952ed5d-721b-4214-9a2f-401f6a66d8a2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:55.009599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e09253-0a8f-4c37-92f1-124adc782b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:55.009599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e09253-0a8f-4c37-92f1-124adc782b05 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:55.009599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e09253-0a8f-4c37-92f1-124adc782b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:55.009599 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e09253-0a8f-4c37-92f1-124adc782b05 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:55.010162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e09253-0a8f-4c37-92f1-124adc782b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:55.011836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e09253-0a8f-4c37-92f1-124adc782b05 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:55.050159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1232/2440] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:48:54 2022] POST /identity/v3/users => generated 292 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:48:55.051425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359ac81-2dfe-4067-bc2d-4568f22b95a6 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:55.063151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359ac81-2dfe-4067-bc2d-4568f22b95a6 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:55.071381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d690a2-c045-4c86-b50f-bd39027a1bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:55.072240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d690a2-c045-4c86-b50f-bd39027a1bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:55.072728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d690a2-c045-4c86-b50f-bd39027a1bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:55.073250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d690a2-c045-4c86-b50f-bd39027a1bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:55.075319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d690a2-c045-4c86-b50f-bd39027a1bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:55.077241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d690a2-c045-4c86-b50f-bd39027a1bb7 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:55.090825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1209/2441] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:55.094867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e09253-0a8f-4c37-92f1-124adc782b05 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:55.105576 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e09253-0a8f-4c37-92f1-124adc782b05 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:55.110383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b442f-6c09-45b3-93ff-5674d16f0b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:55.111275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b442f-6c09-45b3-93ff-5674d16f0b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:55.111555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b442f-6c09-45b3-93ff-5674d16f0b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:55.111846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5b442f-6c09-45b3-93ff-5674d16f0b8a admin admin] PATH_INFO: `/v3/projects/2264c89629084cb198b3ab0a4605671d/users/55aa4154daa14a5a824961c8b183cb29/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:55.130057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b442f-6c09-45b3-93ff-5674d16f0b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2264c89629084cb198b3ab0a4605671d, user_id=55aa4154daa14a5a824961c8b183cb29, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:55.133546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5b442f-6c09-45b3-93ff-5674d16f0b8a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:55.153216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1233/2442] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:55 2022] PUT /identity/v3/projects/2264c89629084cb198b3ab0a4605671d/users/55aa4154daa14a5a824961c8b183cb29/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:55.155460 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d690a2-c045-4c86-b50f-bd39027a1bb7 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:55.167319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d690a2-c045-4c86-b50f-bd39027a1bb7 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:55.243833 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1314186b-2c23-4e16-92d2-7dbbdb62aade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:55.244521 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314186b-2c23-4e16-92d2-7dbbdb62aade admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:55.245500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314186b-2c23-4e16-92d2-7dbbdb62aade admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:55.245781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1314186b-2c23-4e16-92d2-7dbbdb62aade admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:55.246566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314186b-2c23-4e16-92d2-7dbbdb62aade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:55.248628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1314186b-2c23-4e16-92d2-7dbbdb62aade admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:55.260907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1210/2443] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:48:55.265121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b442f-6c09-45b3-93ff-5674d16f0b8a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:55.276259 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5b442f-6c09-45b3-93ff-5674d16f0b8a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:55.281612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734ce98-cce4-4972-bf6b-d51ab3b96085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:55.282859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ce98-cce4-4972-bf6b-d51ab3b96085 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:55.283135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ce98-cce4-4972-bf6b-d51ab3b96085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:55.283401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734ce98-cce4-4972-bf6b-d51ab3b96085 admin admin] PATH_INFO: `/v3/projects/2264c89629084cb198b3ab0a4605671d/users/55aa4154daa14a5a824961c8b183cb29/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:55.285956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734ce98-cce4-4972-bf6b-d51ab3b96085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2264c89629084cb198b3ab0a4605671d, user_id=55aa4154daa14a5a824961c8b183cb29, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:55.289324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734ce98-cce4-4972-bf6b-d51ab3b96085 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:55.302374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1234/2444] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:48:55 2022] PUT /identity/v3/projects/2264c89629084cb198b3ab0a4605671d/users/55aa4154daa14a5a824961c8b183cb29/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:48:56.079311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396164ae-2b14-488d-b2ad-276bfc0b6b4a None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:56.079896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396164ae-2b14-488d-b2ad-276bfc0b6b4a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:56.079896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396164ae-2b14-488d-b2ad-276bfc0b6b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:56.106747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:48:56.116888 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-396164ae-2b14-488d-b2ad-276bfc0b6b4a None None] MFA Rules not processed for user `55aa4154daa14a5a824961c8b183cb29`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:56.119785 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-396164ae-2b14-488d-b2ad-276bfc0b6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:56.234713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1211/2445] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:48:56.245766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a5750-824c-41e1-96d0-c90fde7d0e99 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:56.246401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a5750-824c-41e1-96d0-c90fde7d0e99 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:56.246401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a5750-824c-41e1-96d0-c90fde7d0e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:56.274280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-da8a5750-824c-41e1-96d0-c90fde7d0e99 None None] MFA Rules not processed for user `afbd8db46add416e8b9b32e64e9393e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:48:56.276577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-da8a5750-824c-41e1-96d0-c90fde7d0e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:56.334589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1235/2446] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:48:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:48:56.345142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396164ae-2b14-488d-b2ad-276bfc0b6b4a None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:48:56.346701 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-396164ae-2b14-488d-b2ad-276bfc0b6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:48:56.423397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396164ae-2b14-488d-b2ad-276bfc0b6b4a None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:48:56.429552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971db6fa-03aa-4797-8af9-ed7a3309fc57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:48:56.430243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db6fa-03aa-4797-8af9-ed7a3309fc57 service nova] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:48:56.430525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db6fa-03aa-4797-8af9-ed7a3309fc57 service nova] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:48:56.430800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db6fa-03aa-4797-8af9-ed7a3309fc57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:48:56.439033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971db6fa-03aa-4797-8af9-ed7a3309fc57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:48:56.441232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971db6fa-03aa-4797-8af9-ed7a3309fc57 service nova] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:48:56.450974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1212/2447] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:48:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:01.051679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a5750-824c-41e1-96d0-c90fde7d0e99 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:01.106505 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:01.126815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a5750-824c-41e1-96d0-c90fde7d0e99 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:01.140902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:01.141862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:01.142202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:01.142511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] PATH_INFO: `/v3/users/526fd9a388014b4d9b1e96970fc5d130` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:01.143894 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=526fd9a388014b4d9b1e96970fc5d130)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:01.147963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:01.210512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526fd9a388014b4d9b1e96970fc5d130'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:01.221885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526fd9a388014b4d9b1e96970fc5d130'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:01.222653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526fd9a388014b4d9b1e96970fc5d130'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:01.237726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526fd9a388014b4d9b1e96970fc5d130'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:01.245441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526fd9a388014b4d9b1e96970fc5d130'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:01.252487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1236/2448] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:01 2022] DELETE /identity/v3/users/526fd9a388014b4d9b1e96970fc5d130 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:01.257246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff257be-7b78-4daa-ae77-e6293a997f9e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:01.257705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff257be-7b78-4daa-ae77-e6293a997f9e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:01.257816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff257be-7b78-4daa-ae77-e6293a997f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:01.290423 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-aff257be-7b78-4daa-ae77-e6293a997f9e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:01.291815 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-aff257be-7b78-4daa-ae77-e6293a997f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:01.358900 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1213/2449] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:01.369238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:01.370946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:01.429887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae88f7-e9c0-42ed-8a64-7b8b0de649a0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:01.434019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df287-9cf9-45cd-b9d8-35bbe66a7ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:01.434809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df287-9cf9-45cd-b9d8-35bbe66a7ffa service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:01.435157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df287-9cf9-45cd-b9d8-35bbe66a7ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:01.435504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528df287-9cf9-45cd-b9d8-35bbe66a7ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:01.445773 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528df287-9cf9-45cd-b9d8-35bbe66a7ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:01.447270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528df287-9cf9-45cd-b9d8-35bbe66a7ffa service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:01.486910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1237/2450] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:49:01.949313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff257be-7b78-4daa-ae77-e6293a997f9e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:01.951071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-aff257be-7b78-4daa-ae77-e6293a997f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:01.964518 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff257be-7b78-4daa-ae77-e6293a997f9e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:01.975682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:01.977498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:01.977858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:01.978301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] PATH_INFO: `/v3/projects/6ed0717a52ca4eaba5b042c9bb60acdc` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:01.979945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed0717a52ca4eaba5b042c9bb60acdc)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:01.982022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:02.004416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:02.037256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed0717a52ca4eaba5b042c9bb60acdc', 'request_id': 'req-ea257165-da83-4849-b951-57366c0b2f3a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:02.045383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed0717a52ca4eaba5b042c9bb60acdc', 'request_id': 'req-ea257165-da83-4849-b951-57366c0b2f3a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:02.052312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed0717a52ca4eaba5b042c9bb60acdc', 'request_id': 'req-ea257165-da83-4849-b951-57366c0b2f3a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:02.062996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] The token cache is being invalidate because project 6ed0717a52ca4eaba5b042c9bb60acdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:02.063282 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:02.064080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:02.066422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1214/2451] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:01 2022] DELETE /identity/v3/projects/6ed0717a52ca4eaba5b042c9bb60acdc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:02.070606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df287-9cf9-45cd-b9d8-35bbe66a7ffa service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:02.081620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528df287-9cf9-45cd-b9d8-35bbe66a7ffa service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:02.145532 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:02.146458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:02.147394 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:02.147685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] PATH_INFO: `/v3/users/4ff758766af14d94b467070be21cfd43` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:02.149724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff758766af14d94b467070be21cfd43)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:02.151899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:02.166402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:02.202373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff758766af14d94b467070be21cfd43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:02.209801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff758766af14d94b467070be21cfd43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:02.210442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff758766af14d94b467070be21cfd43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:02.226483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff758766af14d94b467070be21cfd43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:02.233301 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-41b76874-b5c4-43af-995b-2e6f378b6a72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff758766af14d94b467070be21cfd43'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:02.239926 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1238/2452] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:02 2022] DELETE /identity/v3/users/4ff758766af14d94b467070be21cfd43 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:02.963200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:02.966479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:02.988499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea257165-da83-4849-b951-57366c0b2f3a admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.066938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.068292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.068292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.068595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] PATH_INFO: `/v3/projects/6e8b6273101c44dcbde96e3dc4841198` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.070134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8b6273101c44dcbde96e3dc4841198)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.071855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.132319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8b6273101c44dcbde96e3dc4841198', 'request_id': 'req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:03.145291 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8b6273101c44dcbde96e3dc4841198', 'request_id': 'req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:03.154605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8b6273101c44dcbde96e3dc4841198', 'request_id': 'req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:03.167171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] The token cache is being invalidate because project 6e8b6273101c44dcbde96e3dc4841198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:03.167480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:03.168135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-76fbb0d9-114d-4a1d-bea5-e5231acebc6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:03.169823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1215/2453] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:02 2022] DELETE /identity/v3/projects/6e8b6273101c44dcbde96e3dc4841198 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:03.177790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1906f7-0948-4827-8b77-e359f74ab694 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.177790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1906f7-0948-4827-8b77-e359f74ab694 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.177790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1906f7-0948-4827-8b77-e359f74ab694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.194128 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ff1906f7-0948-4827-8b77-e359f74ab694 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:03.195347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ff1906f7-0948-4827-8b77-e359f74ab694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:03.256683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1239/2454] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:03.264614 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91269866-ccef-42e4-b535-e28ee155c67d None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.264903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91269866-ccef-42e4-b535-e28ee155c67d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.265178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91269866-ccef-42e4-b535-e28ee155c67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.284588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-91269866-ccef-42e4-b535-e28ee155c67d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:03.285804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-91269866-ccef-42e4-b535-e28ee155c67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:03.293707 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1216/2455] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:03.298132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1906f7-0948-4827-8b77-e359f74ab694 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.307922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1906f7-0948-4827-8b77-e359f74ab694 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.312399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49175847-6e30-4b9f-8bc4-7415ffac4e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.313047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49175847-6e30-4b9f-8bc4-7415ffac4e53 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.313330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49175847-6e30-4b9f-8bc4-7415ffac4e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.313602 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49175847-6e30-4b9f-8bc4-7415ffac4e53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.314494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49175847-6e30-4b9f-8bc4-7415ffac4e53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:03.315273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49175847-6e30-4b9f-8bc4-7415ffac4e53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.316865 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49175847-6e30-4b9f-8bc4-7415ffac4e53 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.328324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1240/2456] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:03.333185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91269866-ccef-42e4-b535-e28ee155c67d None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.342606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91269866-ccef-42e4-b535-e28ee155c67d None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.347314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567a51d-329b-43a6-92da-033e7308a888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.347964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567a51d-329b-43a6-92da-033e7308a888 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.348249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567a51d-329b-43a6-92da-033e7308a888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.348528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567a51d-329b-43a6-92da-033e7308a888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.349258 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567a51d-329b-43a6-92da-033e7308a888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.351197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567a51d-329b-43a6-92da-033e7308a888 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.376422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1217/2457] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:03 2022] POST /identity/v3/projects => generated 357 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:03.381561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49175847-6e30-4b9f-8bc4-7415ffac4e53 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.391800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49175847-6e30-4b9f-8bc4-7415ffac4e53 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.449055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750af019-cac9-45a1-a206-7cf443b02c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.449651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af019-cac9-45a1-a206-7cf443b02c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.449982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af019-cac9-45a1-a206-7cf443b02c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.450234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750af019-cac9-45a1-a206-7cf443b02c86 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.450945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750af019-cac9-45a1-a206-7cf443b02c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.452954 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750af019-cac9-45a1-a206-7cf443b02c86 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.473184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1241/2458] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:03 2022] POST /identity/v3/users => generated 279 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:03.477277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567a51d-329b-43a6-92da-033e7308a888 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.487735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567a51d-329b-43a6-92da-033e7308a888 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.492373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7bf67-0645-44b6-97b7-4645b182e1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.493044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7bf67-0645-44b6-97b7-4645b182e1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.493325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7bf67-0645-44b6-97b7-4645b182e1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.493597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7bf67-0645-44b6-97b7-4645b182e1d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.494363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7bf67-0645-44b6-97b7-4645b182e1d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.495973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7bf67-0645-44b6-97b7-4645b182e1d8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.497421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:03.510198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1218/2459] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:03.514581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750af019-cac9-45a1-a206-7cf443b02c86 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.525121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750af019-cac9-45a1-a206-7cf443b02c86 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.529964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac4e226-9787-434f-aaa0-0636c4008929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.530662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4e226-9787-434f-aaa0-0636c4008929 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.530940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4e226-9787-434f-aaa0-0636c4008929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.531211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac4e226-9787-434f-aaa0-0636c4008929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.531933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4e226-9787-434f-aaa0-0636c4008929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.533585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac4e226-9787-434f-aaa0-0636c4008929 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.535041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:03.547251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1242/2460] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:03.553766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7bf67-0645-44b6-97b7-4645b182e1d8 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.561039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7bf67-0645-44b6-97b7-4645b182e1d8 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.566224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c31524-793e-48b9-aa79-47e618e445af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.567104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c31524-793e-48b9-aa79-47e618e445af admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.567384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c31524-793e-48b9-aa79-47e618e445af admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.567658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c31524-793e-48b9-aa79-47e618e445af admin admin] PATH_INFO: `/v3/projects/65cb670f965843df847d61c8879a932b/users/886f3ce769704f9da7cad319bcf873df/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.582905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c31524-793e-48b9-aa79-47e618e445af admin admin] RBAC: Authorizing `identity:create_grant(project_id=65cb670f965843df847d61c8879a932b, user_id=886f3ce769704f9da7cad319bcf873df, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.585561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c31524-793e-48b9-aa79-47e618e445af admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.598434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1219/2461] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:03 2022] PUT /identity/v3/projects/65cb670f965843df847d61c8879a932b/users/886f3ce769704f9da7cad319bcf873df/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:03.609969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e88c9-5ee1-4a39-8ac1-bcac41a96de3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.610291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e88c9-5ee1-4a39-8ac1-bcac41a96de3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.610587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507e88c9-5ee1-4a39-8ac1-bcac41a96de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.638839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-507e88c9-5ee1-4a39-8ac1-bcac41a96de3 None None] MFA Rules not processed for user `886f3ce769704f9da7cad319bcf873df`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:03.640052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-507e88c9-5ee1-4a39-8ac1-bcac41a96de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:03.709460 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1243/2462] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:03 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:03.712855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c31524-793e-48b9-aa79-47e618e445af admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.776253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c31524-793e-48b9-aa79-47e618e445af admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.780966 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637da6d-7a3c-417e-bc09-b345a2d4c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.781618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637da6d-7a3c-417e-bc09-b345a2d4c432 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.781896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637da6d-7a3c-417e-bc09-b345a2d4c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.782198 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637da6d-7a3c-417e-bc09-b345a2d4c432 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.783004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637da6d-7a3c-417e-bc09-b345a2d4c432 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.784978 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637da6d-7a3c-417e-bc09-b345a2d4c432 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.811016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1220/2463] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:03 2022] POST /identity/v3/projects => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:03.815885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e88c9-5ee1-4a39-8ac1-bcac41a96de3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.826629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507e88c9-5ee1-4a39-8ac1-bcac41a96de3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.884118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8277-687b-4506-ac87-9bc86579fb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.884791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8277-687b-4506-ac87-9bc86579fb4b admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.885072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8277-687b-4506-ac87-9bc86579fb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.885348 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd8277-687b-4506-ac87-9bc86579fb4b admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.886028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8277-687b-4506-ac87-9bc86579fb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.887979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd8277-687b-4506-ac87-9bc86579fb4b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.909327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1244/2464] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:03 2022] POST /identity/v3/users => generated 285 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:03.915244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637da6d-7a3c-417e-bc09-b345a2d4c432 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.926418 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637da6d-7a3c-417e-bc09-b345a2d4c432 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.931653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32dc76-5756-4b9d-84f1-af4095abcfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.932090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32dc76-5756-4b9d-84f1-af4095abcfbb admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.932380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32dc76-5756-4b9d-84f1-af4095abcfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.932745 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32dc76-5756-4b9d-84f1-af4095abcfbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.933399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32dc76-5756-4b9d-84f1-af4095abcfbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.935062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32dc76-5756-4b9d-84f1-af4095abcfbb admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:03.947891 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1221/2465] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:03.952341 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8277-687b-4506-ac87-9bc86579fb4b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:03.964838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd8277-687b-4506-ac87-9bc86579fb4b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:03.969939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7ab3e-2f58-4c7f-b7ab-6f959beeff36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:03.970982 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ab3e-2f58-4c7f-b7ab-6f959beeff36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:03.971337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ab3e-2f58-4c7f-b7ab-6f959beeff36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:03.971681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7ab3e-2f58-4c7f-b7ab-6f959beeff36 admin admin] PATH_INFO: `/v3/projects/3723af5cd9b44e01ad5c24a3b4e2df48/users/23e1cb6e41f042c4bbaf22f2eb8562d3/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:03.988133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7ab3e-2f58-4c7f-b7ab-6f959beeff36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3723af5cd9b44e01ad5c24a3b4e2df48, user_id=23e1cb6e41f042c4bbaf22f2eb8562d3, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:03.990877 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7ab3e-2f58-4c7f-b7ab-6f959beeff36 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:04.006047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1245/2466] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:03 2022] PUT /identity/v3/projects/3723af5cd9b44e01ad5c24a3b4e2df48/users/23e1cb6e41f042c4bbaf22f2eb8562d3/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:04.010315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32dc76-5756-4b9d-84f1-af4095abcfbb admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:04.020655 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32dc76-5756-4b9d-84f1-af4095abcfbb admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:04.082246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef636a1-8178-40d7-aa8a-e1974d980f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:04.082713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef636a1-8178-40d7-aa8a-e1974d980f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:04.083070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef636a1-8178-40d7-aa8a-e1974d980f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:04.083420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef636a1-8178-40d7-aa8a-e1974d980f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:04.084232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef636a1-8178-40d7-aa8a-e1974d980f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:04.085923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef636a1-8178-40d7-aa8a-e1974d980f61 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:04.097727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1222/2467] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:04.101856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7ab3e-2f58-4c7f-b7ab-6f959beeff36 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:04.112941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7ab3e-2f58-4c7f-b7ab-6f959beeff36 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:04.118565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093914-c40a-47ac-a844-bc0f4bcad067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:04.119725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093914-c40a-47ac-a844-bc0f4bcad067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:04.119989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093914-c40a-47ac-a844-bc0f4bcad067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:04.120426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e093914-c40a-47ac-a844-bc0f4bcad067 admin admin] PATH_INFO: `/v3/projects/3723af5cd9b44e01ad5c24a3b4e2df48/users/23e1cb6e41f042c4bbaf22f2eb8562d3/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:04.122431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e093914-c40a-47ac-a844-bc0f4bcad067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3723af5cd9b44e01ad5c24a3b4e2df48, user_id=23e1cb6e41f042c4bbaf22f2eb8562d3, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:04.125414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e093914-c40a-47ac-a844-bc0f4bcad067 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:04.136481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1246/2468] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:04 2022] PUT /identity/v3/projects/3723af5cd9b44e01ad5c24a3b4e2df48/users/23e1cb6e41f042c4bbaf22f2eb8562d3/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:04.147062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9d4d-1fa1-4ef4-9bab-c49e7324f191 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:04.147349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9d4d-1fa1-4ef4-9bab-c49e7324f191 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:04.147626 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd9d4d-1fa1-4ef4-9bab-c49e7324f191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:04.177227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-acdd9d4d-1fa1-4ef4-9bab-c49e7324f191 None None] MFA Rules not processed for user `23e1cb6e41f042c4bbaf22f2eb8562d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:04.179302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-acdd9d4d-1fa1-4ef4-9bab-c49e7324f191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:04.214442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:04.257810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1223/2469] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:04.273430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093914-c40a-47ac-a844-bc0f4bcad067 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:04.286562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8e093914-c40a-47ac-a844-bc0f4bcad067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:04.332837 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:04.350468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e093914-c40a-47ac-a844-bc0f4bcad067 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:04.354258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cfd584-8a3c-4631-aa2e-b9d43a9286bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:04.354907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd584-8a3c-4631-aa2e-b9d43a9286bd service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:04.355190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd584-8a3c-4631-aa2e-b9d43a9286bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:04.355466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cfd584-8a3c-4631-aa2e-b9d43a9286bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:04.365402 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd584-8a3c-4631-aa2e-b9d43a9286bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:04.366873 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cfd584-8a3c-4631-aa2e-b9d43a9286bd service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:04.376603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1247/2470] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:04 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:04.453311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd9d4d-1fa1-4ef4-9bab-c49e7324f191 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:04.463496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd9d4d-1fa1-4ef4-9bab-c49e7324f191 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:04.467103 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54770710-8658-4e00-a803-fe2668652b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:04.467793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54770710-8658-4e00-a803-fe2668652b6e service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:04.468073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54770710-8658-4e00-a803-fe2668652b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:04.468349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54770710-8658-4e00-a803-fe2668652b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:04.484385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d672b-cc7b-415c-88a4-d5f85704dc78 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:04.484762 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d672b-cc7b-415c-88a4-d5f85704dc78 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:04.485103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d672b-cc7b-415c-88a4-d5f85704dc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:04.503691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-496d672b-cc7b-415c-88a4-d5f85704dc78 None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:04.505012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-496d672b-cc7b-415c-88a4-d5f85704dc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:04.528716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54770710-8658-4e00-a803-fe2668652b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:04.530517 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54770710-8658-4e00-a803-fe2668652b6e service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:04.541492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1224/2471] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:04 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:49:04.567327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1248/2472] 10.222.0.79 () {58 vars in 1009 bytes} [Wed May 25 14:49:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:04.590893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54770710-8658-4e00-a803-fe2668652b6e service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:04.592462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-54770710-8658-4e00-a803-fe2668652b6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:04.681094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54770710-8658-4e00-a803-fe2668652b6e service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:04.687332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b70c5-8178-47f6-b438-968494f0b162 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:04.688076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b70c5-8178-47f6-b438-968494f0b162 service swift] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:04.688434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b70c5-8178-47f6-b438-968494f0b162 service swift] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:04.688801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b70c5-8178-47f6-b438-968494f0b162 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:04.702658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b70c5-8178-47f6-b438-968494f0b162 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:04.703551 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b70c5-8178-47f6-b438-968494f0b162 service swift] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:04.712268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1225/2473] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:49:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 14:49:14.559882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=34 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:14.708746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=75 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:18.854828 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d672b-cc7b-415c-88a4-d5f85704dc78 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:18.868523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d672b-cc7b-415c-88a4-d5f85704dc78 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:18.873217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f381b-84be-4d9f-a6ba-2df79339190f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:18.873946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f381b-84be-4d9f-a6ba-2df79339190f service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:18.874434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f381b-84be-4d9f-a6ba-2df79339190f service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:18.874788 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f381b-84be-4d9f-a6ba-2df79339190f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:18.877403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3f6f381b-84be-4d9f-a6ba-2df79339190f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:18.971993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f381b-84be-4d9f-a6ba-2df79339190f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:18.973453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f381b-84be-4d9f-a6ba-2df79339190f service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:18.984438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1249/2474] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:20.472227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b70c5-8178-47f6-b438-968494f0b162 service swift] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:20.539202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b70c5-8178-47f6-b438-968494f0b162 service swift] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:20.543803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:20.544738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.545024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.545305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] PATH_INFO: `/v3/users/886f3ce769704f9da7cad319bcf873df` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.546536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886f3ce769704f9da7cad319bcf873df)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:20.548979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:20.600313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886f3ce769704f9da7cad319bcf873df'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:20.600979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886f3ce769704f9da7cad319bcf873df'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:20.601598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886f3ce769704f9da7cad319bcf873df'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:20.615484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886f3ce769704f9da7cad319bcf873df'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:20.623270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886f3ce769704f9da7cad319bcf873df'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:20.641183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1226/2475] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:20 2022] DELETE /identity/v3/users/886f3ce769704f9da7cad319bcf873df => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:20.645911 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f171ea-716f-49cb-ad9f-b8845da2d2e3 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.646515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f171ea-716f-49cb-ad9f-b8845da2d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.646515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f171ea-716f-49cb-ad9f-b8845da2d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.665785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-87f171ea-716f-49cb-ad9f-b8845da2d2e3 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:20.667131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-87f171ea-716f-49cb-ad9f-b8845da2d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:20.742615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1250/2476] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:20.752243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:20.753649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:20.825046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd2284-c2d6-4115-8018-1831e58808a4 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:20.829029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71966a-73ad-4013-ac59-acb93fbe02a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:20.829771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71966a-73ad-4013-ac59-acb93fbe02a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:20.830058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71966a-73ad-4013-ac59-acb93fbe02a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:20.830362 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f71966a-73ad-4013-ac59-acb93fbe02a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:20.839715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71966a-73ad-4013-ac59-acb93fbe02a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:20.841147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f71966a-73ad-4013-ac59-acb93fbe02a7 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:20.851524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1227/2477] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:21.136316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f171ea-716f-49cb-ad9f-b8845da2d2e3 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:21.138518 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-87f171ea-716f-49cb-ad9f-b8845da2d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:21.157158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f171ea-716f-49cb-ad9f-b8845da2d2e3 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:21.167395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:21.168629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:21.169000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:21.169337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] PATH_INFO: `/v3/projects/65cb670f965843df847d61c8879a932b` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:21.170726 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65cb670f965843df847d61c8879a932b)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:21.172842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:21.233689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65cb670f965843df847d61c8879a932b', 'request_id': 'req-b0e17ff7-542f-42cd-82b3-4af92e8edc99'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.243585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65cb670f965843df847d61c8879a932b', 'request_id': 'req-b0e17ff7-542f-42cd-82b3-4af92e8edc99'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.250630 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65cb670f965843df847d61c8879a932b', 'request_id': 'req-b0e17ff7-542f-42cd-82b3-4af92e8edc99'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.262072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] The token cache is being invalidate because project 65cb670f965843df847d61c8879a932b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:21.262389 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.263047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.264663 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1251/2478] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:21 2022] DELETE /identity/v3/projects/65cb670f965843df847d61c8879a932b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:21.270669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71966a-73ad-4013-ac59-acb93fbe02a7 service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:21.280923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f71966a-73ad-4013-ac59-acb93fbe02a7 service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:21.300429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:21.351836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:21.352642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:21.352927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:21.353212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] PATH_INFO: `/v3/users/23e1cb6e41f042c4bbaf22f2eb8562d3` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:21.354480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e1cb6e41f042c4bbaf22f2eb8562d3)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:21.356536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:21.404154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e1cb6e41f042c4bbaf22f2eb8562d3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.404808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e1cb6e41f042c4bbaf22f2eb8562d3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.405416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e1cb6e41f042c4bbaf22f2eb8562d3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.417190 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e1cb6e41f042c4bbaf22f2eb8562d3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.424207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e234cce4-d0a5-48e5-a3bc-c90ff19c0e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e1cb6e41f042c4bbaf22f2eb8562d3'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.438744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1228/2479] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:21 2022] DELETE /identity/v3/users/23e1cb6e41f042c4bbaf22f2eb8562d3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:21.712850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:21.714340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:21.727781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e17ff7-542f-42cd-82b3-4af92e8edc99 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:21.749411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:21.807166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:21.808033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:21.808312 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:21.808585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] PATH_INFO: `/v3/projects/3723af5cd9b44e01ad5c24a3b4e2df48` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:21.809785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3723af5cd9b44e01ad5c24a3b4e2df48)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:21.812011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:21.866193 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3723af5cd9b44e01ad5c24a3b4e2df48', 'request_id': 'req-bfd7ea76-6920-4460-8b41-9e00d5314d0b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.876234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3723af5cd9b44e01ad5c24a3b4e2df48', 'request_id': 'req-bfd7ea76-6920-4460-8b41-9e00d5314d0b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.884745 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3723af5cd9b44e01ad5c24a3b4e2df48', 'request_id': 'req-bfd7ea76-6920-4460-8b41-9e00d5314d0b'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.895971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] The token cache is being invalidate because project 3723af5cd9b44e01ad5c24a3b4e2df48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:21.896267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.896924 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-bfd7ea76-6920-4460-8b41-9e00d5314d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:21.898512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1252/2480] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:21 2022] DELETE /identity/v3/projects/3723af5cd9b44e01ad5c24a3b4e2df48 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:21.903449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e802a-23b0-41f2-b969-1e8659b00800 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:21.903927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e802a-23b0-41f2-b969-1e8659b00800 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:21.904063 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e802a-23b0-41f2-b969-1e8659b00800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:21.923039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-288e802a-23b0-41f2-b969-1e8659b00800 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:21.925200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-288e802a-23b0-41f2-b969-1e8659b00800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:21.997504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1229/2481] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:22.006483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084d504-486f-453c-9e43-84814bb2d37b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.006797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084d504-486f-453c-9e43-84814bb2d37b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.007080 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084d504-486f-453c-9e43-84814bb2d37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.026847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-2084d504-486f-453c-9e43-84814bb2d37b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:22.028072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2084d504-486f-453c-9e43-84814bb2d37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:22.036101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1253/2482] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:22.040352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e802a-23b0-41f2-b969-1e8659b00800 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.052343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e802a-23b0-41f2-b969-1e8659b00800 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.056987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5f453-fc9a-4cc0-a94c-57f4b7f8617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.057659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5f453-fc9a-4cc0-a94c-57f4b7f8617d admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.057932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5f453-fc9a-4cc0-a94c-57f4b7f8617d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.058232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a5f453-fc9a-4cc0-a94c-57f4b7f8617d admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.058965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5f453-fc9a-4cc0-a94c-57f4b7f8617d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:22.059276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5f453-fc9a-4cc0-a94c-57f4b7f8617d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.060940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a5f453-fc9a-4cc0-a94c-57f4b7f8617d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.073541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1230/2483] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:22.079081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084d504-486f-453c-9e43-84814bb2d37b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.088406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084d504-486f-453c-9e43-84814bb2d37b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.094838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605add98-efc8-4a10-b2e9-f813236469d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.096025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605add98-efc8-4a10-b2e9-f813236469d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.096307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605add98-efc8-4a10-b2e9-f813236469d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.096580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605add98-efc8-4a10-b2e9-f813236469d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.097265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605add98-efc8-4a10-b2e9-f813236469d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.099223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605add98-efc8-4a10-b2e9-f813236469d6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.124963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1254/2484] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:22.129001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5f453-fc9a-4cc0-a94c-57f4b7f8617d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.139608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a5f453-fc9a-4cc0-a94c-57f4b7f8617d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.167912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:22.200850 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e24df5-c606-4c5e-86a2-c2245ab929a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.201530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e24df5-c606-4c5e-86a2-c2245ab929a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.201808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e24df5-c606-4c5e-86a2-c2245ab929a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.202114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e24df5-c606-4c5e-86a2-c2245ab929a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.202803 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e24df5-c606-4c5e-86a2-c2245ab929a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.204711 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e24df5-c606-4c5e-86a2-c2245ab929a7 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.225002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1231/2485] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:22.229107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605add98-efc8-4a10-b2e9-f813236469d6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.240369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605add98-efc8-4a10-b2e9-f813236469d6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.245099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396b99d-08d7-4dbf-9e1d-3b6b74638c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.245781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396b99d-08d7-4dbf-9e1d-3b6b74638c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.246046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396b99d-08d7-4dbf-9e1d-3b6b74638c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.246356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396b99d-08d7-4dbf-9e1d-3b6b74638c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.247086 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396b99d-08d7-4dbf-9e1d-3b6b74638c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.248716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396b99d-08d7-4dbf-9e1d-3b6b74638c7b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.259676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1255/2486] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:22.263720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e24df5-c606-4c5e-86a2-c2245ab929a7 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.274057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e24df5-c606-4c5e-86a2-c2245ab929a7 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.278761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9311386f-05d0-450a-aea6-d463ecdae432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.279435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311386f-05d0-450a-aea6-d463ecdae432 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.279720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311386f-05d0-450a-aea6-d463ecdae432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.279994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311386f-05d0-450a-aea6-d463ecdae432 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.280867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311386f-05d0-450a-aea6-d463ecdae432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.283156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9311386f-05d0-450a-aea6-d463ecdae432 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.297083 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1232/2487] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:22.298939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396b99d-08d7-4dbf-9e1d-3b6b74638c7b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.309035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396b99d-08d7-4dbf-9e1d-3b6b74638c7b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.313738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99661daa-667d-4e2c-a0da-c73d1113873b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.314653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99661daa-667d-4e2c-a0da-c73d1113873b admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.314939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99661daa-667d-4e2c-a0da-c73d1113873b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.315217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99661daa-667d-4e2c-a0da-c73d1113873b admin admin] PATH_INFO: `/v3/projects/981b211a4c714aedbdfc15902ada4ab4/users/e331ec89914a4a9fa71067e0d3b7faa5/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.335657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99661daa-667d-4e2c-a0da-c73d1113873b admin admin] RBAC: Authorizing `identity:create_grant(project_id=981b211a4c714aedbdfc15902ada4ab4, user_id=e331ec89914a4a9fa71067e0d3b7faa5, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.338633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99661daa-667d-4e2c-a0da-c73d1113873b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.355756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1256/2488] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:22 2022] PUT /identity/v3/projects/981b211a4c714aedbdfc15902ada4ab4/users/e331ec89914a4a9fa71067e0d3b7faa5/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:22.366399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea75d-12f9-4925-a7a7-aa620f278151 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.366861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea75d-12f9-4925-a7a7-aa620f278151 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.367250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcea75d-12f9-4925-a7a7-aa620f278151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.400527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-fbcea75d-12f9-4925-a7a7-aa620f278151 None None] MFA Rules not processed for user `e331ec89914a4a9fa71067e0d3b7faa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:22.402725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fbcea75d-12f9-4925-a7a7-aa620f278151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:22.497056 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1233/2489] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:22.501681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99661daa-667d-4e2c-a0da-c73d1113873b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.534957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00eb4f-7f35-4984-981d-53a4d1e64d0a None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.535321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00eb4f-7f35-4984-981d-53a4d1e64d0a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.535665 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00eb4f-7f35-4984-981d-53a4d1e64d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.561527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-5e00eb4f-7f35-4984-981d-53a4d1e64d0a None None] MFA Rules not processed for user `be474c0453a0403b8db884a89fe9e486`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:22.562824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5e00eb4f-7f35-4984-981d-53a4d1e64d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:22.582404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:22.621074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99661daa-667d-4e2c-a0da-c73d1113873b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.633751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9e3af-240c-4b92-b056-6928872b1795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.635247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e3af-240c-4b92-b056-6928872b1795 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.635833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e3af-240c-4b92-b056-6928872b1795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.636307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9e3af-240c-4b92-b056-6928872b1795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.637716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9e3af-240c-4b92-b056-6928872b1795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.641249 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b9e3af-240c-4b92-b056-6928872b1795 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.668616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1234/2490] 10.222.0.79 () {58 vars in 967 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:22.685861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00eb4f-7f35-4984-981d-53a4d1e64d0a None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.688543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5e00eb4f-7f35-4984-981d-53a4d1e64d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:22.698385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1257/2491] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/projects => generated 375 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:22.703457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9e3af-240c-4b92-b056-6928872b1795 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.752419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:22.793028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9e3af-240c-4b92-b056-6928872b1795 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.798398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9a737-e742-4b44-bda4-e4fd44a8ee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.799139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9a737-e742-4b44-bda4-e4fd44a8ee58 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.799491 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9a737-e742-4b44-bda4-e4fd44a8ee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.799848 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9a737-e742-4b44-bda4-e4fd44a8ee58 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.800624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9a737-e742-4b44-bda4-e4fd44a8ee58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.802671 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9a737-e742-4b44-bda4-e4fd44a8ee58 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.804125 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00eb4f-7f35-4984-981d-53a4d1e64d0a None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.826202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1258/2492] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:22 2022] POST /identity/v3/users => generated 294 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:22.831831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9a737-e742-4b44-bda4-e4fd44a8ee58 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.850009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9a737-e742-4b44-bda4-e4fd44a8ee58 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.856128 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd09a9-2c38-481a-99a9-39b67019436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.857952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd09a9-2c38-481a-99a9-39b67019436c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.858865 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd09a9-2c38-481a-99a9-39b67019436c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.859110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd09a9-2c38-481a-99a9-39b67019436c admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.859867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd09a9-2c38-481a-99a9-39b67019436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.862036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd09a9-2c38-481a-99a9-39b67019436c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.873361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1259/2493] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:22.879903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd09a9-2c38-481a-99a9-39b67019436c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.890640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd09a9-2c38-481a-99a9-39b67019436c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:22.895976 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ad4c6-5651-4ae7-9db1-6de8d674d87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.896851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ad4c6-5651-4ae7-9db1-6de8d674d87d admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.897165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ad4c6-5651-4ae7-9db1-6de8d674d87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.897473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ad4c6-5651-4ae7-9db1-6de8d674d87d admin admin] PATH_INFO: `/v3/projects/cb72232948c642f388e47b587c93ff56/users/581b422dce6d464b96a1a4edc0d364bc/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:22.913647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ad4c6-5651-4ae7-9db1-6de8d674d87d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb72232948c642f388e47b587c93ff56, user_id=581b422dce6d464b96a1a4edc0d364bc, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:22.916405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ad4c6-5651-4ae7-9db1-6de8d674d87d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:22.931838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1260/2494] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:22 2022] PUT /identity/v3/projects/cb72232948c642f388e47b587c93ff56/users/581b422dce6d464b96a1a4edc0d364bc/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:22.933909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3f2b0-a865-42d8-9c05-4730b40a7b88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa04ddd7a6ce4bbabdfca31721b9c71d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:22.935384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3f2b0-a865-42d8-9c05-4730b40a7b88 service swift] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:22.935720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ad4c6-5651-4ae7-9db1-6de8d674d87d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:22.935963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3f2b0-a865-42d8-9c05-4730b40a7b88 service swift] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:22.936480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3f2b0-a865-42d8-9c05-4730b40a7b88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.038513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ad4c6-5651-4ae7-9db1-6de8d674d87d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:23.044446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12831432-c025-4756-a53d-3bd729eab6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:23.045105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831432-c025-4756-a53d-3bd729eab6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:23.045384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831432-c025-4756-a53d-3bd729eab6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:23.045661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12831432-c025-4756-a53d-3bd729eab6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.046421 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12831432-c025-4756-a53d-3bd729eab6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:23.048020 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12831432-c025-4756-a53d-3bd729eab6ee admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:23.056533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3f2b0-a865-42d8-9c05-4730b40a7b88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:23.060318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea3f2b0-a865-42d8-9c05-4730b40a7b88 service swift] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:23.063458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1261/2495] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:23.065216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12831432-c025-4756-a53d-3bd729eab6ee admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:23.075800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1235/2496] 10.222.0.79 () {60 vars in 1384 bytes} [Wed May 25 14:49:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 14:49:23.082567 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12831432-c025-4756-a53d-3bd729eab6ee admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:23.101216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f8a11-67af-4a18-ba18-a03c12c10e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:23.102804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f8a11-67af-4a18-ba18-a03c12c10e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:23.103379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f8a11-67af-4a18-ba18-a03c12c10e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:23.104121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f8a11-67af-4a18-ba18-a03c12c10e3b admin admin] PATH_INFO: `/v3/projects/cb72232948c642f388e47b587c93ff56/users/581b422dce6d464b96a1a4edc0d364bc/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.106541 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f8a11-67af-4a18-ba18-a03c12c10e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb72232948c642f388e47b587c93ff56, user_id=581b422dce6d464b96a1a4edc0d364bc, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:23.109211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f8a11-67af-4a18-ba18-a03c12c10e3b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:23.121228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1262/2497] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:23 2022] PUT /identity/v3/projects/cb72232948c642f388e47b587c93ff56/users/581b422dce6d464b96a1a4edc0d364bc/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:23.138770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a3aa2-2ac7-4185-942c-2cac9f90a9f2 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:23.139390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a3aa2-2ac7-4185-942c-2cac9f90a9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:23.139974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a3aa2-2ac7-4185-942c-2cac9f90a9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.180973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a48a3aa2-2ac7-4185-942c-2cac9f90a9f2 None None] MFA Rules not processed for user `581b422dce6d464b96a1a4edc0d364bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:23.182130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a48a3aa2-2ac7-4185-942c-2cac9f90a9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:23.284643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1236/2498] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:23.296847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f8a11-67af-4a18-ba18-a03c12c10e3b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:23.299479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5f8f8a11-67af-4a18-ba18-a03c12c10e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:23.311958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:23.375069 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f8a11-67af-4a18-ba18-a03c12c10e3b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:23.381390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b9ff4-818c-4f1a-85f1-07f2a09c7bf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:23.382041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b9ff4-818c-4f1a-85f1-07f2a09c7bf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:23.382373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b9ff4-818c-4f1a-85f1-07f2a09c7bf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:23.382669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9b9ff4-818c-4f1a-85f1-07f2a09c7bf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:23.447493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b9ff4-818c-4f1a-85f1-07f2a09c7bf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:23.449011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9b9ff4-818c-4f1a-85f1-07f2a09c7bf4 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:23.468672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1263/2499] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:26.062971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a3aa2-2ac7-4185-942c-2cac9f90a9f2 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:26.075677 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a3aa2-2ac7-4185-942c-2cac9f90a9f2 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:26.081872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dad6b-fa78-4698-b725-39ab68d365db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:26.082592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dad6b-fa78-4698-b725-39ab68d365db service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:26.082878 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dad6b-fa78-4698-b725-39ab68d365db service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:26.083159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08dad6b-fa78-4698-b725-39ab68d365db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:26.098810 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dad6b-fa78-4698-b725-39ab68d365db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:26.099808 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08dad6b-fa78-4698-b725-39ab68d365db service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:26.104519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:26.114169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1237/2500] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:32.416012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b9ff4-818c-4f1a-85f1-07f2a09c7bf4 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:32.418054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ca9b9ff4-818c-4f1a-85f1-07f2a09c7bf4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:32.483555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9b9ff4-818c-4f1a-85f1-07f2a09c7bf4 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:32.487866 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86848e0-88a1-4848-9b12-ab60742b6075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:32.488507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86848e0-88a1-4848-9b12-ab60742b6075 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:32.488789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86848e0-88a1-4848-9b12-ab60742b6075 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:32.489061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86848e0-88a1-4848-9b12-ab60742b6075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:32.490910 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d86848e0-88a1-4848-9b12-ab60742b6075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:32.559604 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86848e0-88a1-4848-9b12-ab60742b6075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:32.561148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86848e0-88a1-4848-9b12-ab60742b6075 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:32.572731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1264/2501] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:36.108835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:36.214784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dad6b-fa78-4698-b725-39ab68d365db service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:36.216484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a08dad6b-fa78-4698-b725-39ab68d365db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:36.232772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08dad6b-fa78-4698-b725-39ab68d365db service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:36.238168 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:36.239051 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:36.239336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:36.239614 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] PATH_INFO: `/v3/users/4e2fc01480c04ff2988700d0474adebc` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:36.240827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2fc01480c04ff2988700d0474adebc)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:36.242801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:36.291793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2fc01480c04ff2988700d0474adebc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:36.292449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2fc01480c04ff2988700d0474adebc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:36.293041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2fc01480c04ff2988700d0474adebc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:36.306997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2fc01480c04ff2988700d0474adebc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:36.314611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a70b2a15-ff4e-4e07-b33f-12c78140a39c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2fc01480c04ff2988700d0474adebc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:36.331196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1238/2502] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:36 2022] DELETE /identity/v3/users/4e2fc01480c04ff2988700d0474adebc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:36.527179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86848e0-88a1-4848-9b12-ab60742b6075 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:36.537820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86848e0-88a1-4848-9b12-ab60742b6075 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:36.546481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:36.601443 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:36.601683 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:36.601933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:36.602395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] PATH_INFO: `/v3/projects/6029f080cf6e4a97878efea92c45357a` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:36.603633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6029f080cf6e4a97878efea92c45357a)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:36.605676 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:36.664013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6029f080cf6e4a97878efea92c45357a', 'request_id': 'req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:36.677525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6029f080cf6e4a97878efea92c45357a', 'request_id': 'req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:36.683826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6029f080cf6e4a97878efea92c45357a', 'request_id': 'req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:36.710206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] The token cache is being invalidate because project 6029f080cf6e4a97878efea92c45357a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:36.710506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:36.711535 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-04e32bd9-8e38-4f92-9731-fbe0b3bb0a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:36.716901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1265/2503] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:36 2022] DELETE /identity/v3/projects/6029f080cf6e4a97878efea92c45357a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:36.718653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043b67-c47c-4f06-8c68-be24683ae42a None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:36.718950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043b67-c47c-4f06-8c68-be24683ae42a None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:36.719316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca043b67-c47c-4f06-8c68-be24683ae42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:36.743245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-ca043b67-c47c-4f06-8c68-be24683ae42a None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:36.744797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ca043b67-c47c-4f06-8c68-be24683ae42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:36.835896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1239/2504] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:36.844225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2173d-87c1-47d0-b93b-7aeb86b0e086 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:36.844511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2173d-87c1-47d0-b93b-7aeb86b0e086 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:36.845329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2173d-87c1-47d0-b93b-7aeb86b0e086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:36.879804 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e2b2173d-87c1-47d0-b93b-7aeb86b0e086 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:36.881562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e2b2173d-87c1-47d0-b93b-7aeb86b0e086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:36.890491 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1266/2505] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:36.896827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043b67-c47c-4f06-8c68-be24683ae42a None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:36.909895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca043b67-c47c-4f06-8c68-be24683ae42a None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:36.915295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cd37f-61de-459f-ac52-688ae725b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:36.916107 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd37f-61de-459f-ac52-688ae725b6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:36.916488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd37f-61de-459f-ac52-688ae725b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:36.916845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446cd37f-61de-459f-ac52-688ae725b6a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:36.917795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cd37f-61de-459f-ac52-688ae725b6a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:36.917992 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cd37f-61de-459f-ac52-688ae725b6a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:36.920166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446cd37f-61de-459f-ac52-688ae725b6a8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:36.942909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1240/2506] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:49:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:36.946992 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2173d-87c1-47d0-b93b-7aeb86b0e086 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:36.962440 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2173d-87c1-47d0-b93b-7aeb86b0e086 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:36.968942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a1fc5-8e9e-4411-83ab-010073981a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:36.970423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a1fc5-8e9e-4411-83ab-010073981a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:36.970800 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a1fc5-8e9e-4411-83ab-010073981a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:36.971079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a1fc5-8e9e-4411-83ab-010073981a14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:36.971858 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a1fc5-8e9e-4411-83ab-010073981a14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:36.974516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a1fc5-8e9e-4411-83ab-010073981a14 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:37.011703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1267/2507] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:36 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:37.015504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cd37f-61de-459f-ac52-688ae725b6a8 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:37.028300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446cd37f-61de-459f-ac52-688ae725b6a8 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:37.114894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b512c-b9f8-4f6b-8e71-7d8d8e2f8b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:37.115602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b512c-b9f8-4f6b-8e71-7d8d8e2f8b92 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:37.117320 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b512c-b9f8-4f6b-8e71-7d8d8e2f8b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:37.117609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b512c-b9f8-4f6b-8e71-7d8d8e2f8b92 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:37.118389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b512c-b9f8-4f6b-8e71-7d8d8e2f8b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:37.120381 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b512c-b9f8-4f6b-8e71-7d8d8e2f8b92 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:37.127989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:37.147255 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1241/2508] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:37 2022] POST /identity/v3/users => generated 293 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:37.152268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a1fc5-8e9e-4411-83ab-010073981a14 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:37.164640 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a1fc5-8e9e-4411-83ab-010073981a14 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:37.169870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e94467-2a8d-4d91-a723-4d18707923a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:37.170601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e94467-2a8d-4d91-a723-4d18707923a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:37.171231 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e94467-2a8d-4d91-a723-4d18707923a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:37.171355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e94467-2a8d-4d91-a723-4d18707923a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:37.172042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e94467-2a8d-4d91-a723-4d18707923a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:37.173699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e94467-2a8d-4d91-a723-4d18707923a6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:37.191066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1268/2509] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:37.196552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b512c-b9f8-4f6b-8e71-7d8d8e2f8b92 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:37.208674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b512c-b9f8-4f6b-8e71-7d8d8e2f8b92 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:37.214590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15846806-c9b3-4b9b-ad2e-91da584b4ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:37.215267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15846806-c9b3-4b9b-ad2e-91da584b4ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:37.215593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15846806-c9b3-4b9b-ad2e-91da584b4ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:37.215886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15846806-c9b3-4b9b-ad2e-91da584b4ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:37.216715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15846806-c9b3-4b9b-ad2e-91da584b4ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:37.218375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15846806-c9b3-4b9b-ad2e-91da584b4ea6 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:37.230276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1242/2510] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:37.234540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e94467-2a8d-4d91-a723-4d18707923a6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:37.245624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e94467-2a8d-4d91-a723-4d18707923a6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:37.250465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ec22c-af8f-4172-a4ab-d83fdd43bd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:37.251886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ec22c-af8f-4172-a4ab-d83fdd43bd88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:37.252195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ec22c-af8f-4172-a4ab-d83fdd43bd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:37.252470 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ec22c-af8f-4172-a4ab-d83fdd43bd88 admin admin] PATH_INFO: `/v3/projects/ad28fc468f444f8dae25509bd0ab29b0/users/8ee19c43de9242289b265a521886eb48/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:37.270986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ec22c-af8f-4172-a4ab-d83fdd43bd88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad28fc468f444f8dae25509bd0ab29b0, user_id=8ee19c43de9242289b265a521886eb48, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:37.273661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ec22c-af8f-4172-a4ab-d83fdd43bd88 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:37.293611 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1269/2511] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:37 2022] PUT /identity/v3/projects/ad28fc468f444f8dae25509bd0ab29b0/users/8ee19c43de9242289b265a521886eb48/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:37.303915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df6e2-e562-42bf-a8f1-283f3d15f65c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:37.304205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df6e2-e562-42bf-a8f1-283f3d15f65c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:37.304486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043df6e2-e562-42bf-a8f1-283f3d15f65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:37.334048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-043df6e2-e562-42bf-a8f1-283f3d15f65c None None] MFA Rules not processed for user `8ee19c43de9242289b265a521886eb48`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:37.335322 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-043df6e2-e562-42bf-a8f1-283f3d15f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:37.412237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1243/2512] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:37.425088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ec22c-af8f-4172-a4ab-d83fdd43bd88 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:37.427005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bc6ec22c-af8f-4172-a4ab-d83fdd43bd88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:37.472042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:37.511213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ec22c-af8f-4172-a4ab-d83fdd43bd88 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:37.517299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3e6f9-98e2-4800-9472-1b3a5d8ef695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:37.518025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3e6f9-98e2-4800-9472-1b3a5d8ef695 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:37.518329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3e6f9-98e2-4800-9472-1b3a5d8ef695 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:37.518713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3e6f9-98e2-4800-9472-1b3a5d8ef695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:37.528088 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3e6f9-98e2-4800-9472-1b3a5d8ef695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:37.530025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3e6f9-98e2-4800-9472-1b3a5d8ef695 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:37.539923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1270/2513] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:39.358047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043df6e2-e562-42bf-a8f1-283f3d15f65c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:39.359492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-043df6e2-e562-42bf-a8f1-283f3d15f65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:39.433866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043df6e2-e562-42bf-a8f1-283f3d15f65c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:39.439222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:39.440108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:39.440384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:39.440660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] PATH_INFO: `/v3/users/e331ec89914a4a9fa71067e0d3b7faa5` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:39.441857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e331ec89914a4a9fa71067e0d3b7faa5)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:39.443846 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:39.491842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e331ec89914a4a9fa71067e0d3b7faa5'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:39.492486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e331ec89914a4a9fa71067e0d3b7faa5'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:39.493075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e331ec89914a4a9fa71067e0d3b7faa5'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:39.506428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e331ec89914a4a9fa71067e0d3b7faa5'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:39.511656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:39.516227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e331ec89914a4a9fa71067e0d3b7faa5'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:39.530630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1244/2514] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:39 2022] DELETE /identity/v3/users/e331ec89914a4a9fa71067e0d3b7faa5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:39.535239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3e41-9af7-48f6-bd0b-b9447d45f321 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:39.535723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3e41-9af7-48f6-bd0b-b9447d45f321 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:39.535852 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e3e41-9af7-48f6-bd0b-b9447d45f321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:39.552840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-908e3e41-9af7-48f6-bd0b-b9447d45f321 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:39.554046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-908e3e41-9af7-48f6-bd0b-b9447d45f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:39.620460 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1271/2515] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:39.631099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:39.632555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:39.696321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85acd5-ade1-410f-b939-a6c4df3d0eec admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:39.700650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e390e2c-536e-4f57-aed4-6307cce07c1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:39.701624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e390e2c-536e-4f57-aed4-6307cce07c1d service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:39.701777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e390e2c-536e-4f57-aed4-6307cce07c1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:39.702057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e390e2c-536e-4f57-aed4-6307cce07c1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:39.712861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e390e2c-536e-4f57-aed4-6307cce07c1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:39.714353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e390e2c-536e-4f57-aed4-6307cce07c1d service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:39.725156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1245/2516] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:40.036697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3e41-9af7-48f6-bd0b-b9447d45f321 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:40.038598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-908e3e41-9af7-48f6-bd0b-b9447d45f321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:40.054597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e3e41-9af7-48f6-bd0b-b9447d45f321 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:40.060174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:40.061190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:40.061646 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:40.062024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] PATH_INFO: `/v3/projects/981b211a4c714aedbdfc15902ada4ab4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:40.064200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=981b211a4c714aedbdfc15902ada4ab4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:40.066286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:40.117885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '981b211a4c714aedbdfc15902ada4ab4', 'request_id': 'req-6b00b091-8286-45ee-94e3-52b19bb748ec'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.125381 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '981b211a4c714aedbdfc15902ada4ab4', 'request_id': 'req-6b00b091-8286-45ee-94e3-52b19bb748ec'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.132070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '981b211a4c714aedbdfc15902ada4ab4', 'request_id': 'req-6b00b091-8286-45ee-94e3-52b19bb748ec'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.142417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] The token cache is being invalidate because project 981b211a4c714aedbdfc15902ada4ab4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:40.142705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.143356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.144918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1272/2517] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:40 2022] DELETE /identity/v3/projects/981b211a4c714aedbdfc15902ada4ab4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:40.149057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e390e2c-536e-4f57-aed4-6307cce07c1d service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:40.159743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e390e2c-536e-4f57-aed4-6307cce07c1d service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:40.220827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:40.221698 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:40.221983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:40.222293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] PATH_INFO: `/v3/users/581b422dce6d464b96a1a4edc0d364bc` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:40.223492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=581b422dce6d464b96a1a4edc0d364bc)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:40.225424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:40.276827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581b422dce6d464b96a1a4edc0d364bc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.277505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581b422dce6d464b96a1a4edc0d364bc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.278132 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581b422dce6d464b96a1a4edc0d364bc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.290551 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581b422dce6d464b96a1a4edc0d364bc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.297368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a21a36c6-c070-4461-9549-dcc5511d42f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581b422dce6d464b96a1a4edc0d364bc'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.315031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1246/2518] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:40 2022] DELETE /identity/v3/users/581b422dce6d464b96a1a4edc0d364bc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:40.630827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:40.632882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:40.648067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00b091-8286-45ee-94e3-52b19bb748ec admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:40.704985 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:40.722367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:40.723675 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:40.724105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:40.724545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] PATH_INFO: `/v3/projects/cb72232948c642f388e47b587c93ff56` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:40.726025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb72232948c642f388e47b587c93ff56)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:40.727995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:40.777751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb72232948c642f388e47b587c93ff56', 'request_id': 'req-27c9f1e6-469f-48cf-97bb-74545589e088'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.786656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb72232948c642f388e47b587c93ff56', 'request_id': 'req-27c9f1e6-469f-48cf-97bb-74545589e088'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.793128 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb72232948c642f388e47b587c93ff56', 'request_id': 'req-27c9f1e6-469f-48cf-97bb-74545589e088'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.804889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] The token cache is being invalidate because project cb72232948c642f388e47b587c93ff56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:40.805249 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.805977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-27c9f1e6-469f-48cf-97bb-74545589e088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:40.807827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1273/2519] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:40 2022] DELETE /identity/v3/projects/cb72232948c642f388e47b587c93ff56 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:40.813973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c321427-4433-415a-bb08-95d943be7fb1 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:40.814530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c321427-4433-415a-bb08-95d943be7fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:40.814683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c321427-4433-415a-bb08-95d943be7fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:40.833048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1c321427-4433-415a-bb08-95d943be7fb1 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:40.834328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1c321427-4433-415a-bb08-95d943be7fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:40.838719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:40.898641 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1247/2520] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:40.907261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae683ff5-69da-4182-8a47-c9af62df7615 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:40.907554 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae683ff5-69da-4182-8a47-c9af62df7615 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:40.907943 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae683ff5-69da-4182-8a47-c9af62df7615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:40.926864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ae683ff5-69da-4182-8a47-c9af62df7615 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:40.928143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ae683ff5-69da-4182-8a47-c9af62df7615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:40.937251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1274/2521] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:40.943902 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c321427-4433-415a-bb08-95d943be7fb1 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:40.958802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c321427-4433-415a-bb08-95d943be7fb1 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:40.963581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da586a55-f9e2-430e-a342-225057ae90aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:40.964246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da586a55-f9e2-430e-a342-225057ae90aa admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:40.964527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da586a55-f9e2-430e-a342-225057ae90aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:40.964800 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da586a55-f9e2-430e-a342-225057ae90aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:40.965524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da586a55-f9e2-430e-a342-225057ae90aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:40.965838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da586a55-f9e2-430e-a342-225057ae90aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:40.967471 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da586a55-f9e2-430e-a342-225057ae90aa admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:40.980224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1248/2522] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:49:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:49:40.984290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae683ff5-69da-4182-8a47-c9af62df7615 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:40.993784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae683ff5-69da-4182-8a47-c9af62df7615 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:40.998756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400e1c7-ca98-4272-bbdc-7ded552a4a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:40.999555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400e1c7-ca98-4272-bbdc-7ded552a4a68 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:40.999704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400e1c7-ca98-4272-bbdc-7ded552a4a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:40.999965 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400e1c7-ca98-4272-bbdc-7ded552a4a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.001175 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400e1c7-ca98-4272-bbdc-7ded552a4a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.003223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400e1c7-ca98-4272-bbdc-7ded552a4a68 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.036401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1275/2523] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:40 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:41.037538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da586a55-f9e2-430e-a342-225057ae90aa admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.048452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da586a55-f9e2-430e-a342-225057ae90aa admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.115516 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23f850-930f-4a67-a93c-442a8ede8f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.116197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23f850-930f-4a67-a93c-442a8ede8f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.116482 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23f850-930f-4a67-a93c-442a8ede8f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.116763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23f850-930f-4a67-a93c-442a8ede8f45 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.117475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23f850-930f-4a67-a93c-442a8ede8f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.119481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23f850-930f-4a67-a93c-442a8ede8f45 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.146121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1249/2524] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:41 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:41.147806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400e1c7-ca98-4272-bbdc-7ded552a4a68 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.158363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400e1c7-ca98-4272-bbdc-7ded552a4a68 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.163700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36759952-24d9-4eee-8731-adeb51d232c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.164461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36759952-24d9-4eee-8731-adeb51d232c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.164744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36759952-24d9-4eee-8731-adeb51d232c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.165022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36759952-24d9-4eee-8731-adeb51d232c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.165753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36759952-24d9-4eee-8731-adeb51d232c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.167407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36759952-24d9-4eee-8731-adeb51d232c2 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.182128 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1276/2525] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:41.186334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23f850-930f-4a67-a93c-442a8ede8f45 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.199156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23f850-930f-4a67-a93c-442a8ede8f45 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.203126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93e923-16da-464f-9040-11a7cfaabd71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.203860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93e923-16da-464f-9040-11a7cfaabd71 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.204147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93e923-16da-464f-9040-11a7cfaabd71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.204432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93e923-16da-464f-9040-11a7cfaabd71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.205180 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93e923-16da-464f-9040-11a7cfaabd71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.207149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a93e923-16da-464f-9040-11a7cfaabd71 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.219816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1250/2526] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:41.224397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36759952-24d9-4eee-8731-adeb51d232c2 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.236035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36759952-24d9-4eee-8731-adeb51d232c2 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.245118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174eed54-1339-4811-b659-a1253623f7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.246047 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174eed54-1339-4811-b659-a1253623f7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.246360 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174eed54-1339-4811-b659-a1253623f7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.246670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174eed54-1339-4811-b659-a1253623f7ac admin admin] PATH_INFO: `/v3/projects/082ff66217f7452d9b4b44a572b93c35/users/08fdb44a080b498a84680f6da4a9c836/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.265258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174eed54-1339-4811-b659-a1253623f7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=082ff66217f7452d9b4b44a572b93c35, user_id=08fdb44a080b498a84680f6da4a9c836, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.268007 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174eed54-1339-4811-b659-a1253623f7ac admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.282378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1277/2527] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:41 2022] PUT /identity/v3/projects/082ff66217f7452d9b4b44a572b93c35/users/08fdb44a080b498a84680f6da4a9c836/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:41.292615 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e5f8-6a15-4288-ad38-9265eb8f6146 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.292904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e5f8-6a15-4288-ad38-9265eb8f6146 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.293200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e5f8-6a15-4288-ad38-9265eb8f6146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.325787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c0a5e5f8-6a15-4288-ad38-9265eb8f6146 None None] MFA Rules not processed for user `08fdb44a080b498a84680f6da4a9c836`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:41.327052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c0a5e5f8-6a15-4288-ad38-9265eb8f6146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:41.398560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1251/2528] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:41.403141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174eed54-1339-4811-b659-a1253623f7ac admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.490009 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174eed54-1339-4811-b659-a1253623f7ac admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.497775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71772ee2-db56-475d-962a-574512899ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.499056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71772ee2-db56-475d-962a-574512899ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.499556 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71772ee2-db56-475d-962a-574512899ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.500042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71772ee2-db56-475d-962a-574512899ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.501373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71772ee2-db56-475d-962a-574512899ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.505071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71772ee2-db56-475d-962a-574512899ed9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.537564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:41.554147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1278/2529] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:41 2022] POST /identity/v3/projects => generated 379 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:41.558275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5e5f8-6a15-4288-ad38-9265eb8f6146 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.571470 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:41.586031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5e5f8-6a15-4288-ad38-9265eb8f6146 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.707668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81b21c-3ea0-410d-aab4-86c7603a378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.708569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81b21c-3ea0-410d-aab4-86c7603a378d admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.708777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81b21c-3ea0-410d-aab4-86c7603a378d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.709081 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81b21c-3ea0-410d-aab4-86c7603a378d admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.709784 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81b21c-3ea0-410d-aab4-86c7603a378d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.714811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f81b21c-3ea0-410d-aab4-86c7603a378d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.746425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1252/2530] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:41 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:41.752936 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71772ee2-db56-475d-962a-574512899ed9 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.766940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71772ee2-db56-475d-962a-574512899ed9 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.774309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0bd59-786d-4635-9273-7df4387e8661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.775359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0bd59-786d-4635-9273-7df4387e8661 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.775615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0bd59-786d-4635-9273-7df4387e8661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.780593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad0bd59-786d-4635-9273-7df4387e8661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.782582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0bd59-786d-4635-9273-7df4387e8661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.784248 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad0bd59-786d-4635-9273-7df4387e8661 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.796425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1279/2531] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:41.801323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81b21c-3ea0-410d-aab4-86c7603a378d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.812848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f81b21c-3ea0-410d-aab4-86c7603a378d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.817923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15697-e854-480f-bdb2-e1f530842154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.818860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15697-e854-480f-bdb2-e1f530842154 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.819151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15697-e854-480f-bdb2-e1f530842154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.819428 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a15697-e854-480f-bdb2-e1f530842154 admin admin] PATH_INFO: `/v3/projects/c6abff0c7749473dbb81853e6b48ed9b/users/02337eff40dd46618a0fd5bda66e008c/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.835511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a15697-e854-480f-bdb2-e1f530842154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6abff0c7749473dbb81853e6b48ed9b, user_id=02337eff40dd46618a0fd5bda66e008c, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.838237 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a15697-e854-480f-bdb2-e1f530842154 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.862631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1253/2532] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:41 2022] PUT /identity/v3/projects/c6abff0c7749473dbb81853e6b48ed9b/users/02337eff40dd46618a0fd5bda66e008c/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:41.867864 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0bd59-786d-4635-9273-7df4387e8661 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.881591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad0bd59-786d-4635-9273-7df4387e8661 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.949791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8eb5a4-24ae-4b52-9842-f677ff9455b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.950534 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb5a4-24ae-4b52-9842-f677ff9455b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.950819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb5a4-24ae-4b52-9842-f677ff9455b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.951129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8eb5a4-24ae-4b52-9842-f677ff9455b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.952537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb5a4-24ae-4b52-9842-f677ff9455b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:41.954799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8eb5a4-24ae-4b52-9842-f677ff9455b0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:41.965830 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1280/2533] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:41.973293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15697-e854-480f-bdb2-e1f530842154 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:41.985819 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a15697-e854-480f-bdb2-e1f530842154 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:41.991676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c3679-7ad2-46ba-a0f7-a904d5085f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:41.992886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c3679-7ad2-46ba-a0f7-a904d5085f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:41.993181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c3679-7ad2-46ba-a0f7-a904d5085f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:41.993530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c3679-7ad2-46ba-a0f7-a904d5085f2b admin admin] PATH_INFO: `/v3/projects/c6abff0c7749473dbb81853e6b48ed9b/users/02337eff40dd46618a0fd5bda66e008c/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:41.996577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c3679-7ad2-46ba-a0f7-a904d5085f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6abff0c7749473dbb81853e6b48ed9b, user_id=02337eff40dd46618a0fd5bda66e008c, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:42.000085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c3679-7ad2-46ba-a0f7-a904d5085f2b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:42.012756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1254/2534] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:41 2022] PUT /identity/v3/projects/c6abff0c7749473dbb81853e6b48ed9b/users/02337eff40dd46618a0fd5bda66e008c/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:42.026953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cab2d-17e4-4a75-8327-73eefc88415f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:42.027270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cab2d-17e4-4a75-8327-73eefc88415f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:42.027628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cab2d-17e4-4a75-8327-73eefc88415f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:42.057070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-fa2cab2d-17e4-4a75-8327-73eefc88415f None None] MFA Rules not processed for user `02337eff40dd46618a0fd5bda66e008c`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:42.058329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fa2cab2d-17e4-4a75-8327-73eefc88415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:42.139272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1281/2535] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:42.151617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c3679-7ad2-46ba-a0f7-a904d5085f2b admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:42.153506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ac1c3679-7ad2-46ba-a0f7-a904d5085f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:42.199977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cab2d-17e4-4a75-8327-73eefc88415f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:42.200598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fa2cab2d-17e4-4a75-8327-73eefc88415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:42.228133 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c3679-7ad2-46ba-a0f7-a904d5085f2b admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:42.232318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c71f3-603f-49c5-9587-f550c31970b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:42.232974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c71f3-603f-49c5-9587-f550c31970b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:42.233267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c71f3-603f-49c5-9587-f550c31970b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:42.233883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c71f3-603f-49c5-9587-f550c31970b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:42.283403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cab2d-17e4-4a75-8327-73eefc88415f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:42.288286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:42.289167 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:42.289452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:42.289727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] PATH_INFO: `/v3/users/afbd8db46add416e8b9b32e64e9393e2` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:42.290979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afbd8db46add416e8b9b32e64e9393e2)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:42.292927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:42.301280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c71f3-603f-49c5-9587-f550c31970b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:42.302772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0c71f3-603f-49c5-9587-f550c31970b1 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:42.303704 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:42.312414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1255/2536] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:42.355703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afbd8db46add416e8b9b32e64e9393e2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.366999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afbd8db46add416e8b9b32e64e9393e2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.367969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afbd8db46add416e8b9b32e64e9393e2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.383178 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afbd8db46add416e8b9b32e64e9393e2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.390964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afbd8db46add416e8b9b32e64e9393e2'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.397715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1282/2537] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:42 2022] DELETE /identity/v3/users/afbd8db46add416e8b9b32e64e9393e2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:42.613848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c71f3-603f-49c5-9587-f550c31970b1 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:42.632288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c71f3-603f-49c5-9587-f550c31970b1 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:42.664855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:42.730283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:42.731143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:42.731418 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:42.731806 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] PATH_INFO: `/v3/projects/16a7b422e1774940af4ef7aa70079321` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:42.732968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16a7b422e1774940af4ef7aa70079321)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:42.734961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:42.787186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a7b422e1774940af4ef7aa70079321', 'request_id': 'req-03c68ed7-f57d-4235-9016-e68458ed3129'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.796852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a7b422e1774940af4ef7aa70079321', 'request_id': 'req-03c68ed7-f57d-4235-9016-e68458ed3129'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.808079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a7b422e1774940af4ef7aa70079321', 'request_id': 'req-03c68ed7-f57d-4235-9016-e68458ed3129'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.820971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] The token cache is being invalidate because project 16a7b422e1774940af4ef7aa70079321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:42.821536 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.822478 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.825001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1256/2538] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:42 2022] DELETE /identity/v3/projects/16a7b422e1774940af4ef7aa70079321 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:42.829629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:42.831126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:42.857200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48fc31e-26fc-4846-b5cd-3ece55a5c8b0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:42.924682 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:42.925714 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:42.925995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:42.926298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] PATH_INFO: `/v3/users/55aa4154daa14a5a824961c8b183cb29` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:42.927476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55aa4154daa14a5a824961c8b183cb29)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:42.932994 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:42.944953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:42.946483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:42.959836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c68ed7-f57d-4235-9016-e68458ed3129 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:42.964890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:42.965944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:42.966332 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:42.966713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] PATH_INFO: `/v3/users/8ee19c43de9242289b265a521886eb48` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:42.968181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee19c43de9242289b265a521886eb48)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:42.970896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:42.990725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55aa4154daa14a5a824961c8b183cb29'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.999084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55aa4154daa14a5a824961c8b183cb29'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:42.999942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55aa4154daa14a5a824961c8b183cb29'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.014441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55aa4154daa14a5a824961c8b183cb29'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.021522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee19c43de9242289b265a521886eb48'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.022227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee19c43de9242289b265a521886eb48'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.022408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-c2300898-480d-4672-9908-f209ce316cf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55aa4154daa14a5a824961c8b183cb29'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.022836 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee19c43de9242289b265a521886eb48'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.028703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1283/2539] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:42 2022] DELETE /identity/v3/users/55aa4154daa14a5a824961c8b183cb29 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:43.036865 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee19c43de9242289b265a521886eb48'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.044541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee19c43de9242289b265a521886eb48'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.059054 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1257/2540] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:42 2022] DELETE /identity/v3/users/8ee19c43de9242289b265a521886eb48 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:43.064105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110376c-66a3-4e7c-90cb-6e06dd5235ba None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.064477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110376c-66a3-4e7c-90cb-6e06dd5235ba None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.064819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e110376c-66a3-4e7c-90cb-6e06dd5235ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.081450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:43.089702 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e110376c-66a3-4e7c-90cb-6e06dd5235ba None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:43.091751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e110376c-66a3-4e7c-90cb-6e06dd5235ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.164461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1284/2541] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:43.176466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.178040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.193894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:43.221983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110376c-66a3-4e7c-90cb-6e06dd5235ba None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.223515 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e110376c-66a3-4e7c-90cb-6e06dd5235ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.249100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e110376c-66a3-4e7c-90cb-6e06dd5235ba None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.256905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.258049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.258528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.258808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] PATH_INFO: `/v3/projects/2264c89629084cb198b3ab0a4605671d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.260091 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2264c89629084cb198b3ab0a4605671d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:43.262035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:43.268709 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f3a12-7499-4bc5-ad64-34d573c8ea0a admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.272500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22482c89-14fc-42c3-b6b8-77fcfb9121c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.273151 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22482c89-14fc-42c3-b6b8-77fcfb9121c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.273538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22482c89-14fc-42c3-b6b8-77fcfb9121c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.273712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22482c89-14fc-42c3-b6b8-77fcfb9121c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.284445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22482c89-14fc-42c3-b6b8-77fcfb9121c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:43.286112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22482c89-14fc-42c3-b6b8-77fcfb9121c0 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:43.302277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1258/2542] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:43.320619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2264c89629084cb198b3ab0a4605671d', 'request_id': 'req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.329347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2264c89629084cb198b3ab0a4605671d', 'request_id': 'req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.336335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2264c89629084cb198b3ab0a4605671d', 'request_id': 'req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.353125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] The token cache is being invalidate because project 2264c89629084cb198b3ab0a4605671d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:43.353662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.354720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b49559e2-a3a9-4b51-97ad-82e838d5f2f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.363510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1285/2543] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:43 2022] DELETE /identity/v3/projects/2264c89629084cb198b3ab0a4605671d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:43.365378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a2de4-6ca3-4927-9690-3c9fde9ac253 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.365736 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a2de4-6ca3-4927-9690-3c9fde9ac253 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.366045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a2de4-6ca3-4927-9690-3c9fde9ac253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.386019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-8f4a2de4-6ca3-4927-9690-3c9fde9ac253 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:43.387289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8f4a2de4-6ca3-4927-9690-3c9fde9ac253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.456923 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1259/2544] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:43.465520 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d6ad7-8947-4e7b-aa44-c54915227198 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.465896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d6ad7-8947-4e7b-aa44-c54915227198 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.466270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d6ad7-8947-4e7b-aa44-c54915227198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.486100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-907d6ad7-8947-4e7b-aa44-c54915227198 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:43.487242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-907d6ad7-8947-4e7b-aa44-c54915227198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.495577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1286/2545] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:43.499882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a2de4-6ca3-4927-9690-3c9fde9ac253 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.510299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a2de4-6ca3-4927-9690-3c9fde9ac253 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.515170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc592e16-00c8-4e16-a0b5-c239c9d9981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.515812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592e16-00c8-4e16-a0b5-c239c9d9981c admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.516600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592e16-00c8-4e16-a0b5-c239c9d9981c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.516903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc592e16-00c8-4e16-a0b5-c239c9d9981c admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.517646 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc592e16-00c8-4e16-a0b5-c239c9d9981c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:43.517950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc592e16-00c8-4e16-a0b5-c239c9d9981c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:43.519632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc592e16-00c8-4e16-a0b5-c239c9d9981c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:43.532676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1260/2546] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:49:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:43.538060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d6ad7-8947-4e7b-aa44-c54915227198 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.554013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d6ad7-8947-4e7b-aa44-c54915227198 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.560808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e3d0a-c8d0-4d0a-8fd1-622de3798a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.561710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e3d0a-c8d0-4d0a-8fd1-622de3798a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.562066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e3d0a-c8d0-4d0a-8fd1-622de3798a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.562442 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e3d0a-c8d0-4d0a-8fd1-622de3798a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.563214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e3d0a-c8d0-4d0a-8fd1-622de3798a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:43.565153 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e3d0a-c8d0-4d0a-8fd1-622de3798a44 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:43.598720 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1287/2547] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:43 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:43.599896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc592e16-00c8-4e16-a0b5-c239c9d9981c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.610658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc592e16-00c8-4e16-a0b5-c239c9d9981c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.627691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e3d0a-c8d0-4d0a-8fd1-622de3798a44 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.629525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-245e3d0a-c8d0-4d0a-8fd1-622de3798a44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.688886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998d7c9-252b-45f7-9c7c-b743c9522b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.689961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998d7c9-252b-45f7-9c7c-b743c9522b51 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.690383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998d7c9-252b-45f7-9c7c-b743c9522b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.690732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998d7c9-252b-45f7-9c7c-b743c9522b51 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.691991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998d7c9-252b-45f7-9c7c-b743c9522b51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:43.695548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998d7c9-252b-45f7-9c7c-b743c9522b51 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:43.717506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e3d0a-c8d0-4d0a-8fd1-622de3798a44 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.722964 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.723838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.724120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.724406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] PATH_INFO: `/v3/projects/ad28fc468f444f8dae25509bd0ab29b0` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.726249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1261/2548] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:43 2022] POST /identity/v3/users => generated 287 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:43.728521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad28fc468f444f8dae25509bd0ab29b0)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:43.729565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998d7c9-252b-45f7-9c7c-b743c9522b51 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.731650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:43.735370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:43.755892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998d7c9-252b-45f7-9c7c-b743c9522b51 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.755892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0e8c4-29b2-4e3a-9b9f-e07ea6471b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.755892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0e8c4-29b2-4e3a-9b9f-e07ea6471b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.755892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0e8c4-29b2-4e3a-9b9f-e07ea6471b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.756345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0e8c4-29b2-4e3a-9b9f-e07ea6471b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.756345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0e8c4-29b2-4e3a-9b9f-e07ea6471b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:43.759139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0e8c4-29b2-4e3a-9b9f-e07ea6471b74 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:43.776729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1262/2549] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:43.781078 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0e8c4-29b2-4e3a-9b9f-e07ea6471b74 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.783432 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-eea0e8c4-29b2-4e3a-9b9f-e07ea6471b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.793877 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad28fc468f444f8dae25509bd0ab29b0', 'request_id': 'req-ae8b167a-7c72-4501-b763-d875b58f396e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.803835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad28fc468f444f8dae25509bd0ab29b0', 'request_id': 'req-ae8b167a-7c72-4501-b763-d875b58f396e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.819660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad28fc468f444f8dae25509bd0ab29b0', 'request_id': 'req-ae8b167a-7c72-4501-b763-d875b58f396e'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.821509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:43.839545 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] The token cache is being invalidate because project ad28fc468f444f8dae25509bd0ab29b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:43.840149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.840506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:43.842356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1288/2550] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:43 2022] DELETE /identity/v3/projects/ad28fc468f444f8dae25509bd0ab29b0 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:43.843067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.844400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.860884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0e8c4-29b2-4e3a-9b9f-e07ea6471b74 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.912686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20664283-1c83-4264-8169-7e83e4055b3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.913027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8b167a-7c72-4501-b763-d875b58f396e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.913610 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20664283-1c83-4264-8169-7e83e4055b3c service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.914046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20664283-1c83-4264-8169-7e83e4055b3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.914430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20664283-1c83-4264-8169-7e83e4055b3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.916325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-20664283-1c83-4264-8169-7e83e4055b3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.917815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71944dcd-d384-4f4b-9844-b2f49bdb279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.919011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944dcd-d384-4f4b-9844-b2f49bdb279b admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.919291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944dcd-d384-4f4b-9844-b2f49bdb279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.919565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71944dcd-d384-4f4b-9844-b2f49bdb279b admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.920291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71944dcd-d384-4f4b-9844-b2f49bdb279b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:43.921905 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71944dcd-d384-4f4b-9844-b2f49bdb279b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:43.932990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1289/2551] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:43.934304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc20b9-fcd0-4f99-98ec-7bc99b72e758 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.934594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc20b9-fcd0-4f99-98ec-7bc99b72e758 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.934867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc20b9-fcd0-4f99-98ec-7bc99b72e758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.954563 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-71cc20b9-fcd0-4f99-98ec-7bc99b72e758 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:43.955730 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-71cc20b9-fcd0-4f99-98ec-7bc99b72e758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:43.963956 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1290/2552] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:43.970811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc20b9-fcd0-4f99-98ec-7bc99b72e758 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:43.976451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc20b9-fcd0-4f99-98ec-7bc99b72e758 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:43.981430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37bb70-3d19-49cb-8a27-41e12bf75b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:43.982345 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37bb70-3d19-49cb-8a27-41e12bf75b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:43.982629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37bb70-3d19-49cb-8a27-41e12bf75b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:43.982897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37bb70-3d19-49cb-8a27-41e12bf75b5a admin admin] PATH_INFO: `/v3/projects/e98a83c5c1074f4b853b37f0ef841dae/users/e53f48883c854107a79a2d0eeb754d7d/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:43.990927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20664283-1c83-4264-8169-7e83e4055b3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:43.992389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20664283-1c83-4264-8169-7e83e4055b3c service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:43.998558 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37bb70-3d19-49cb-8a27-41e12bf75b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e98a83c5c1074f4b853b37f0ef841dae, user_id=e53f48883c854107a79a2d0eeb754d7d, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.001773 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37bb70-3d19-49cb-8a27-41e12bf75b5a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.002970 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1263/2553] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:44.004265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909a0e-a63c-406f-b805-05d33d361817 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.004554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909a0e-a63c-406f-b805-05d33d361817 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.005112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a909a0e-a63c-406f-b805-05d33d361817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.029109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1291/2554] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:43 2022] PUT /identity/v3/projects/e98a83c5c1074f4b853b37f0ef841dae/users/e53f48883c854107a79a2d0eeb754d7d/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:44.029738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-5a909a0e-a63c-406f-b805-05d33d361817 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:44.030996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089095d-b465-4c8d-9b36-9754d693cf47 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.031134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5a909a0e-a63c-406f-b805-05d33d361817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:44.031404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089095d-b465-4c8d-9b36-9754d693cf47 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.032081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089095d-b465-4c8d-9b36-9754d693cf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.064969 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c089095d-b465-4c8d-9b36-9754d693cf47 None None] MFA Rules not processed for user `e53f48883c854107a79a2d0eeb754d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:44.066221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c089095d-b465-4c8d-9b36-9754d693cf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:44.104769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1264/2555] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:44.109828 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909a0e-a63c-406f-b805-05d33d361817 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.119795 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a909a0e-a63c-406f-b805-05d33d361817 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.126222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9c1d7-d0f6-4c0b-b550-83ed22fd7910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.126914 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9c1d7-d0f6-4c0b-b550-83ed22fd7910 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.127389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9c1d7-d0f6-4c0b-b550-83ed22fd7910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.127683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9c1d7-d0f6-4c0b-b550-83ed22fd7910 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.128170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:44.128493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9c1d7-d0f6-4c0b-b550-83ed22fd7910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:44.128798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9c1d7-d0f6-4c0b-b550-83ed22fd7910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.131322 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9c1d7-d0f6-4c0b-b550-83ed22fd7910 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.151779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1265/2556] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:49:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:44.153256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9c1d7-d0f6-4c0b-b550-83ed22fd7910 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.157288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1292/2557] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:44.161710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089095d-b465-4c8d-9b36-9754d693cf47 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.173793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9c1d7-d0f6-4c0b-b550-83ed22fd7910 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.174310 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089095d-b465-4c8d-9b36-9754d693cf47 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.179862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb3995-091c-43f8-ac34-e8b5666a3900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.180163 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fad7-ca54-49a8-8ec3-4871d17711c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.180842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb3995-091c-43f8-ac34-e8b5666a3900 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.181129 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb3995-091c-43f8-ac34-e8b5666a3900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.181219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fad7-ca54-49a8-8ec3-4871d17711c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.181401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb3995-091c-43f8-ac34-e8b5666a3900 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.182104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fad7-ca54-49a8-8ec3-4871d17711c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.182228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb3995-091c-43f8-ac34-e8b5666a3900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.182408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fad7-ca54-49a8-8ec3-4871d17711c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.183206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6fad7-ca54-49a8-8ec3-4871d17711c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.185235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb3995-091c-43f8-ac34-e8b5666a3900 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.185652 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6fad7-ca54-49a8-8ec3-4871d17711c5 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.201158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:44.217667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1293/2558] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:44.217909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1266/2559] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:44.219258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fad7-ca54-49a8-8ec3-4871d17711c5 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.222951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb3995-091c-43f8-ac34-e8b5666a3900 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.300472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb3995-091c-43f8-ac34-e8b5666a3900 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.305139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fad7-ca54-49a8-8ec3-4871d17711c5 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.305280 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc98046-f487-4fe4-92ab-ac605eb1a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.305826 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc98046-f487-4fe4-92ab-ac605eb1a75a admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.306104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc98046-f487-4fe4-92ab-ac605eb1a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.306398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc98046-f487-4fe4-92ab-ac605eb1a75a admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.307099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc98046-f487-4fe4-92ab-ac605eb1a75a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.309011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc98046-f487-4fe4-92ab-ac605eb1a75a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.312199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4863d-8711-488c-8ff6-b1bca90de2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.313792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4863d-8711-488c-8ff6-b1bca90de2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.314299 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4863d-8711-488c-8ff6-b1bca90de2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.314736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4863d-8711-488c-8ff6-b1bca90de2a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.315844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4863d-8711-488c-8ff6-b1bca90de2a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.319305 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4863d-8711-488c-8ff6-b1bca90de2a4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.337040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1267/2560] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/users => generated 282 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:44.338609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc98046-f487-4fe4-92ab-ac605eb1a75a admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.351546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1294/2561] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/users => generated 294 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:44.351811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc98046-f487-4fe4-92ab-ac605eb1a75a admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.352901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4863d-8711-488c-8ff6-b1bca90de2a4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.354535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e80fb3-3d83-42cc-b3f8-aed6ca9cff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.355217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e80fb3-3d83-42cc-b3f8-aed6ca9cff4a admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.355502 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e80fb3-3d83-42cc-b3f8-aed6ca9cff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.355796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e80fb3-3d83-42cc-b3f8-aed6ca9cff4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.356741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e80fb3-3d83-42cc-b3f8-aed6ca9cff4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.358393 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e80fb3-3d83-42cc-b3f8-aed6ca9cff4a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.364096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4863d-8711-488c-8ff6-b1bca90de2a4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.368951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde951a-b941-4a03-b9a6-eeee210bf366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.369618 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde951a-b941-4a03-b9a6-eeee210bf366 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.369790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1268/2562] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:44.369888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde951a-b941-4a03-b9a6-eeee210bf366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.370198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde951a-b941-4a03-b9a6-eeee210bf366 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.370923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde951a-b941-4a03-b9a6-eeee210bf366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.372586 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde951a-b941-4a03-b9a6-eeee210bf366 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.373666 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e80fb3-3d83-42cc-b3f8-aed6ca9cff4a admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.384635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e80fb3-3d83-42cc-b3f8-aed6ca9cff4a admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.385033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1295/2563] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:44.389679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde951a-b941-4a03-b9a6-eeee210bf366 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.389947 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c5514-c0fb-4469-9c96-bcd80f4e2386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.390691 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c5514-c0fb-4469-9c96-bcd80f4e2386 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.390950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c5514-c0fb-4469-9c96-bcd80f4e2386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.391263 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c5514-c0fb-4469-9c96-bcd80f4e2386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.392003 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c5514-c0fb-4469-9c96-bcd80f4e2386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.393624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c5514-c0fb-4469-9c96-bcd80f4e2386 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.399896 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde951a-b941-4a03-b9a6-eeee210bf366 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.404636 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2cbba-3471-4e29-9e0b-7e64fe69fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.405033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1269/2564] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:44.405659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2cbba-3471-4e29-9e0b-7e64fe69fcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.405937 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2cbba-3471-4e29-9e0b-7e64fe69fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.406242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2cbba-3471-4e29-9e0b-7e64fe69fcd3 admin admin] PATH_INFO: `/v3/projects/6af02be207344092b21d6ad3e7afeb38/users/576aa4ceac1a4b05a8682bcf9fa6b570/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.409209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c5514-c0fb-4469-9c96-bcd80f4e2386 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.419517 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c5514-c0fb-4469-9c96-bcd80f4e2386 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.422267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2cbba-3471-4e29-9e0b-7e64fe69fcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af02be207344092b21d6ad3e7afeb38, user_id=576aa4ceac1a4b05a8682bcf9fa6b570, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.424959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3d1a7-64ab-4f84-9441-25ebcdcf1fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.425597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2cbba-3471-4e29-9e0b-7e64fe69fcd3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.425904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3d1a7-64ab-4f84-9441-25ebcdcf1fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.426222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3d1a7-64ab-4f84-9441-25ebcdcf1fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.426500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3d1a7-64ab-4f84-9441-25ebcdcf1fc3 admin admin] PATH_INFO: `/v3/projects/d4094ed827e64ebea06da9b9647dea59/users/ec962ee0b8584dafbc6f49d99c03999c/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.440999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1296/2565] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:44 2022] PUT /identity/v3/projects/6af02be207344092b21d6ad3e7afeb38/users/576aa4ceac1a4b05a8682bcf9fa6b570/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:44.444062 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3d1a7-64ab-4f84-9441-25ebcdcf1fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4094ed827e64ebea06da9b9647dea59, user_id=ec962ee0b8584dafbc6f49d99c03999c, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.444983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2cbba-3471-4e29-9e0b-7e64fe69fcd3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.446856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3d1a7-64ab-4f84-9441-25ebcdcf1fc3 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.461863 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1270/2566] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:44 2022] PUT /identity/v3/projects/d4094ed827e64ebea06da9b9647dea59/users/ec962ee0b8584dafbc6f49d99c03999c/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:44.473862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d691fa5-c04e-47ff-b77d-91e2a90cce46 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.474190 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d691fa5-c04e-47ff-b77d-91e2a90cce46 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.474467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d691fa5-c04e-47ff-b77d-91e2a90cce46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.502686 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7d691fa5-c04e-47ff-b77d-91e2a90cce46 None None] MFA Rules not processed for user `ec962ee0b8584dafbc6f49d99c03999c`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:44.503899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7d691fa5-c04e-47ff-b77d-91e2a90cce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:44.515833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2cbba-3471-4e29-9e0b-7e64fe69fcd3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.539769 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:44.577624 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c867e1-c206-4f57-9abf-8e8b8210ea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.578339 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c867e1-c206-4f57-9abf-8e8b8210ea8a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.578666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c867e1-c206-4f57-9abf-8e8b8210ea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.578973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c867e1-c206-4f57-9abf-8e8b8210ea8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.579747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c867e1-c206-4f57-9abf-8e8b8210ea8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.581529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c867e1-c206-4f57-9abf-8e8b8210ea8a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.588147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1271/2567] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:44.593525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d691fa5-c04e-47ff-b77d-91e2a90cce46 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.594673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1297/2568] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:44.597115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c867e1-c206-4f57-9abf-8e8b8210ea8a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.605045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d691fa5-c04e-47ff-b77d-91e2a90cce46 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.608022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c867e1-c206-4f57-9abf-8e8b8210ea8a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.609733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5a6ac-28af-4a3e-906e-696899f9606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.611293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5a6ac-28af-4a3e-906e-696899f9606a admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.611570 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5a6ac-28af-4a3e-906e-696899f9606a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.611838 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5a6ac-28af-4a3e-906e-696899f9606a admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.612528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5a6ac-28af-4a3e-906e-696899f9606a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.614030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ea042-77f3-4286-8c35-4996c5de3203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.614456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb5a6ac-28af-4a3e-906e-696899f9606a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.614949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ea042-77f3-4286-8c35-4996c5de3203 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.615251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ea042-77f3-4286-8c35-4996c5de3203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.615525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ea042-77f3-4286-8c35-4996c5de3203 admin admin] PATH_INFO: `/v3/projects/6af02be207344092b21d6ad3e7afeb38/users/576aa4ceac1a4b05a8682bcf9fa6b570/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.617764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ea042-77f3-4286-8c35-4996c5de3203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6af02be207344092b21d6ad3e7afeb38, user_id=576aa4ceac1a4b05a8682bcf9fa6b570, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.620467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3ea042-77f3-4286-8c35-4996c5de3203 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.635441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1298/2569] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:44 2022] PUT /identity/v3/projects/6af02be207344092b21d6ad3e7afeb38/users/576aa4ceac1a4b05a8682bcf9fa6b570/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:44.648888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a5e6-186f-457f-b882-48eae164f12d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.649271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a5e6-186f-457f-b882-48eae164f12d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.649778 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72a5e6-186f-457f-b882-48eae164f12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.673489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1272/2570] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/projects => generated 363 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:44.674789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5a6ac-28af-4a3e-906e-696899f9606a admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.685738 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:44.686717 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3e72a5e6-186f-457f-b882-48eae164f12d None None] MFA Rules not processed for user `576aa4ceac1a4b05a8682bcf9fa6b570`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:44.688524 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3e72a5e6-186f-457f-b882-48eae164f12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:44.791449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5a6ac-28af-4a3e-906e-696899f9606a admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.797018 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da332b-2adc-4f26-b85a-ce1760aa82ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.798563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da332b-2adc-4f26-b85a-ce1760aa82ca admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.799028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da332b-2adc-4f26-b85a-ce1760aa82ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.799415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da332b-2adc-4f26-b85a-ce1760aa82ca admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.800272 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da332b-2adc-4f26-b85a-ce1760aa82ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.802515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da332b-2adc-4f26-b85a-ce1760aa82ca admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.806807 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1299/2571] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:44.820681 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72a5e6-186f-457f-b882-48eae164f12d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.823511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3e72a5e6-186f-457f-b882-48eae164f12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:44.833026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1273/2572] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:44 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:44.834608 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da332b-2adc-4f26-b85a-ce1760aa82ca admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.845829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da332b-2adc-4f26-b85a-ce1760aa82ca admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.850885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2769b5-ca4c-4179-a463-6b7ac54ca700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.851569 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2769b5-ca4c-4179-a463-6b7ac54ca700 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.851853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2769b5-ca4c-4179-a463-6b7ac54ca700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.852131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2769b5-ca4c-4179-a463-6b7ac54ca700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.852873 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2769b5-ca4c-4179-a463-6b7ac54ca700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.854526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2769b5-ca4c-4179-a463-6b7ac54ca700 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.869469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1274/2573] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:44.870720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2769b5-ca4c-4179-a463-6b7ac54ca700 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.883070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2769b5-ca4c-4179-a463-6b7ac54ca700 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.888710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72a5e6-186f-457f-b882-48eae164f12d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:44.890377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f14ea9-39b5-4d32-87d1-229722afc16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.891837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f14ea9-39b5-4d32-87d1-229722afc16d admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.892315 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f14ea9-39b5-4d32-87d1-229722afc16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.892768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f14ea9-39b5-4d32-87d1-229722afc16d admin admin] PATH_INFO: `/v3/projects/267914388d1d47c686b1d79764598641/users/bbc39781f6104e79ba92ff360a6fc99f/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.894477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e86743-d0b1-4e9e-8afa-b8c8b870677d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:44.895480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e86743-d0b1-4e9e-8afa-b8c8b870677d service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:44.895924 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e86743-d0b1-4e9e-8afa-b8c8b870677d service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:44.896379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e86743-d0b1-4e9e-8afa-b8c8b870677d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:44.915775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f14ea9-39b5-4d32-87d1-229722afc16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=267914388d1d47c686b1d79764598641, user_id=bbc39781f6104e79ba92ff360a6fc99f, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.918721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f14ea9-39b5-4d32-87d1-229722afc16d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.935961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1275/2574] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:44 2022] PUT /identity/v3/projects/267914388d1d47c686b1d79764598641/users/bbc39781f6104e79ba92ff360a6fc99f/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:44.940656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f14ea9-39b5-4d32-87d1-229722afc16d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:44.956390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:44.967187 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e86743-d0b1-4e9e-8afa-b8c8b870677d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:44.968666 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e86743-d0b1-4e9e-8afa-b8c8b870677d service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:44.979423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1300/2575] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:49:45.013860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f14ea9-39b5-4d32-87d1-229722afc16d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:45.019200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d680dd5-2e39-41b7-83eb-bf8b8d4b891b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:45.019993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d680dd5-2e39-41b7-83eb-bf8b8d4b891b admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:45.022409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d680dd5-2e39-41b7-83eb-bf8b8d4b891b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:45.022409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d680dd5-2e39-41b7-83eb-bf8b8d4b891b admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:45.022409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d680dd5-2e39-41b7-83eb-bf8b8d4b891b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:45.022911 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d680dd5-2e39-41b7-83eb-bf8b8d4b891b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:45.037609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1276/2576] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:45.038820 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e86743-d0b1-4e9e-8afa-b8c8b870677d service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:45.049583 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e86743-d0b1-4e9e-8afa-b8c8b870677d service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:45.054270 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8c56d-8e00-409e-9436-b98424f4d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:45.055157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8c56d-8e00-409e-9436-b98424f4d96c admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:45.055438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8c56d-8e00-409e-9436-b98424f4d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:45.055719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8c56d-8e00-409e-9436-b98424f4d96c admin admin] PATH_INFO: `/v3/projects/267914388d1d47c686b1d79764598641/users/bbc39781f6104e79ba92ff360a6fc99f/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:45.057831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8c56d-8e00-409e-9436-b98424f4d96c admin admin] RBAC: Authorizing `identity:create_grant(project_id=267914388d1d47c686b1d79764598641, user_id=bbc39781f6104e79ba92ff360a6fc99f, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:45.060542 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8c56d-8e00-409e-9436-b98424f4d96c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:45.072073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1301/2577] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:45 2022] PUT /identity/v3/projects/267914388d1d47c686b1d79764598641/users/bbc39781f6104e79ba92ff360a6fc99f/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:45.085136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53884ab-1c9e-4ba1-8793-f6ae82051cdc None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:45.085136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53884ab-1c9e-4ba1-8793-f6ae82051cdc None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:45.085136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53884ab-1c9e-4ba1-8793-f6ae82051cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:45.113371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c53884ab-1c9e-4ba1-8793-f6ae82051cdc None None] MFA Rules not processed for user `bbc39781f6104e79ba92ff360a6fc99f`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:45.114722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c53884ab-1c9e-4ba1-8793-f6ae82051cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:45.167829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:45.211883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1277/2578] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:45.293268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8c56d-8e00-409e-9436-b98424f4d96c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:45.295261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-96b8c56d-8e00-409e-9436-b98424f4d96c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:45.368340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8c56d-8e00-409e-9436-b98424f4d96c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:45.372365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ae315-db66-4855-bd66-edec2f58d222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:45.373026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ae315-db66-4855-bd66-edec2f58d222 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:45.373439 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ae315-db66-4855-bd66-edec2f58d222 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:45.373587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ae315-db66-4855-bd66-edec2f58d222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:45.388434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ae315-db66-4855-bd66-edec2f58d222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:45.389922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91ae315-db66-4855-bd66-edec2f58d222 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:45.401596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1302/2579] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:45.518378 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53884ab-1c9e-4ba1-8793-f6ae82051cdc None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:45.529316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53884ab-1c9e-4ba1-8793-f6ae82051cdc None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:45.534098 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabf427-11bc-40e9-acbb-f587ded5a5eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:45.534767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabf427-11bc-40e9-acbb-f587ded5a5eb service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:45.535055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabf427-11bc-40e9-acbb-f587ded5a5eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:45.535333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabf427-11bc-40e9-acbb-f587ded5a5eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:45.605649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabf427-11bc-40e9-acbb-f587ded5a5eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:45.607554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabf427-11bc-40e9-acbb-f587ded5a5eb service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:45.618190 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1278/2580] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:47.737034 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ae315-db66-4855-bd66-edec2f58d222 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:47.800277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ae315-db66-4855-bd66-edec2f58d222 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:47.804836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:47.805706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:47.805986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:47.806288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] PATH_INFO: `/v3/users/e53f48883c854107a79a2d0eeb754d7d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:47.807473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e53f48883c854107a79a2d0eeb754d7d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:47.809396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:47.860944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e53f48883c854107a79a2d0eeb754d7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:47.869359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e53f48883c854107a79a2d0eeb754d7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:47.870191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e53f48883c854107a79a2d0eeb754d7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:47.884111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e53f48883c854107a79a2d0eeb754d7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:47.892337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1bb129c3-77a3-4175-96ae-c3139132059e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e53f48883c854107a79a2d0eeb754d7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:47.893881 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:47.898369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabf427-11bc-40e9-acbb-f587ded5a5eb service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:47.899979 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1303/2581] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:47 2022] DELETE /identity/v3/users/e53f48883c854107a79a2d0eeb754d7d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:47.900275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-cbabf427-11bc-40e9-acbb-f587ded5a5eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:47.904031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef998f-e506-4147-a7c4-00cd027d883c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:47.904453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef998f-e506-4147-a7c4-00cd027d883c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:47.905005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef998f-e506-4147-a7c4-00cd027d883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:47.916384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabf427-11bc-40e9-acbb-f587ded5a5eb service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:47.925452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d7ef998f-e506-4147-a7c4-00cd027d883c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:47.926687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d7ef998f-e506-4147-a7c4-00cd027d883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:47.973653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:47.974481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:47.974759 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:47.975052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] PATH_INFO: `/v3/users/08fdb44a080b498a84680f6da4a9c836` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:47.976247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=08fdb44a080b498a84680f6da4a9c836)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:47.978259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:47.986456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1304/2582] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:47.998786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef998f-e506-4147-a7c4-00cd027d883c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:48.000172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d7ef998f-e506-4147-a7c4-00cd027d883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:48.026506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08fdb44a080b498a84680f6da4a9c836'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.027155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08fdb44a080b498a84680f6da4a9c836'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.027756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08fdb44a080b498a84680f6da4a9c836'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.040621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08fdb44a080b498a84680f6da4a9c836'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.047841 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fa745f6b-13f7-4eb8-9970-0df8232f7d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08fdb44a080b498a84680f6da4a9c836'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.058045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:48.061808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef998f-e506-4147-a7c4-00cd027d883c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:48.067048 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1279/2583] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:47 2022] DELETE /identity/v3/users/08fdb44a080b498a84680f6da4a9c836 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:48.068979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667f16-9fda-46c8-9b79-4b529653ba20 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:48.069341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667f16-9fda-46c8-9b79-4b529653ba20 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:48.069860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3667f16-9fda-46c8-9b79-4b529653ba20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:48.089657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-c3667f16-9fda-46c8-9b79-4b529653ba20 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:48.090898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c3667f16-9fda-46c8-9b79-4b529653ba20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:48.113883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795af62-9198-4a0d-a738-c1fd7451f41f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:48.114581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795af62-9198-4a0d-a738-c1fd7451f41f service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:48.114867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795af62-9198-4a0d-a738-c1fd7451f41f service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:48.115146 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795af62-9198-4a0d-a738-c1fd7451f41f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:48.117154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5795af62-9198-4a0d-a738-c1fd7451f41f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:48.152505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1280/2584] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:48.164138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3667f16-9fda-46c8-9b79-4b529653ba20 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:48.166756 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c3667f16-9fda-46c8-9b79-4b529653ba20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:48.183398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3667f16-9fda-46c8-9b79-4b529653ba20 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:48.187437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f36908-b6d5-4cc1-a037-dc0698eccc33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:48.188651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36908-b6d5-4cc1-a037-dc0698eccc33 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:48.188863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795af62-9198-4a0d-a738-c1fd7451f41f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:48.188982 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36908-b6d5-4cc1-a037-dc0698eccc33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:48.189190 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f36908-b6d5-4cc1-a037-dc0698eccc33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:48.190369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5795af62-9198-4a0d-a738-c1fd7451f41f service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:48.198912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f36908-b6d5-4cc1-a037-dc0698eccc33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:48.200370 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f36908-b6d5-4cc1-a037-dc0698eccc33 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:48.200987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1305/2585] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:49:48.211807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1281/2586] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:48.614398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795af62-9198-4a0d-a738-c1fd7451f41f service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:48.616445 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5795af62-9198-4a0d-a738-c1fd7451f41f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:48.630313 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:48.632412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f36908-b6d5-4cc1-a037-dc0698eccc33 service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:48.634171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-48f36908-b6d5-4cc1-a037-dc0698eccc33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:48.644774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795af62-9198-4a0d-a738-c1fd7451f41f service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:48.655035 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:48.657593 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:48.657882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:48.658188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] PATH_INFO: `/v3/projects/e98a83c5c1074f4b853b37f0ef841dae` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:48.659176 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f36908-b6d5-4cc1-a037-dc0698eccc33 service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:48.660195 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e98a83c5c1074f4b853b37f0ef841dae)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:48.663104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:48.667121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:48.680150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:48.680618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:48.680910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] PATH_INFO: `/v3/projects/082ff66217f7452d9b4b44a572b93c35` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:48.683419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=082ff66217f7452d9b4b44a572b93c35)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:48.688285 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:48.729138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e98a83c5c1074f4b853b37f0ef841dae', 'request_id': 'req-61a5a807-78dd-469a-96e8-33efbf9720a0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.744696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e98a83c5c1074f4b853b37f0ef841dae', 'request_id': 'req-61a5a807-78dd-469a-96e8-33efbf9720a0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.754426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e98a83c5c1074f4b853b37f0ef841dae', 'request_id': 'req-61a5a807-78dd-469a-96e8-33efbf9720a0'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.767659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082ff66217f7452d9b4b44a572b93c35', 'request_id': 'req-72962581-abd9-4a56-a7cb-8ff496fe4d15'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.768420 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] The token cache is being invalidate because project e98a83c5c1074f4b853b37f0ef841dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:48.768856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.769915 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.774854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1306/2587] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:48 2022] DELETE /identity/v3/projects/e98a83c5c1074f4b853b37f0ef841dae => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:48.776079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:48.777763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:48.781221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082ff66217f7452d9b4b44a572b93c35', 'request_id': 'req-72962581-abd9-4a56-a7cb-8ff496fe4d15'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.789797 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082ff66217f7452d9b4b44a572b93c35', 'request_id': 'req-72962581-abd9-4a56-a7cb-8ff496fe4d15'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.805590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] The token cache is being invalidate because project 082ff66217f7452d9b4b44a572b93c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:48.806001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.806831 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:48.808676 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1282/2588] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:48 2022] DELETE /identity/v3/projects/082ff66217f7452d9b4b44a572b93c35 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:48.820977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:48.822710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:48.861213 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5a807-78dd-469a-96e8-33efbf9720a0 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:48.915268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72962581-abd9-4a56-a7cb-8ff496fe4d15 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:48.924637 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:48.925558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:48.925897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:48.926231 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] PATH_INFO: `/v3/users/02337eff40dd46618a0fd5bda66e008c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:48.927552 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=02337eff40dd46618a0fd5bda66e008c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:48.929507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:48.935884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:48.937645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:48.938297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:48.939076 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] PATH_INFO: `/v3/users/576aa4ceac1a4b05a8682bcf9fa6b570` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:48.941708 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] RBAC: Authorizing `identity:delete_user(user_id=576aa4ceac1a4b05a8682bcf9fa6b570)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:48.945369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:48.951268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:49.001705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:49.014003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '576aa4ceac1a4b05a8682bcf9fa6b570'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.015629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02337eff40dd46618a0fd5bda66e008c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.016989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02337eff40dd46618a0fd5bda66e008c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.018772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02337eff40dd46618a0fd5bda66e008c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.024268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '576aa4ceac1a4b05a8682bcf9fa6b570'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.024952 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '576aa4ceac1a4b05a8682bcf9fa6b570'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.034908 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02337eff40dd46618a0fd5bda66e008c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.042815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '576aa4ceac1a4b05a8682bcf9fa6b570'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.045714 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02337eff40dd46618a0fd5bda66e008c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.050897 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '576aa4ceac1a4b05a8682bcf9fa6b570'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.058876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1307/2589] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:48 2022] DELETE /identity/v3/users/576aa4ceac1a4b05a8682bcf9fa6b570 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:49.065813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1283/2590] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:48 2022] DELETE /identity/v3/users/02337eff40dd46618a0fd5bda66e008c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:49.383623 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.385274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:49.389979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.393650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:49.479785 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1dac2-d795-4abd-879b-4a33c84af95c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.482353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4a529-f546-4f71-ac9c-00c5753c7e4d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.485280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.486504 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.486816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.487412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] PATH_INFO: `/v3/projects/6af02be207344092b21d6ad3e7afeb38` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.488437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.488642 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6af02be207344092b21d6ad3e7afeb38)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.489250 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.489528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.489802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] PATH_INFO: `/v3/projects/c6abff0c7749473dbb81853e6b48ed9b` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.491271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.491390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6abff0c7749473dbb81853e6b48ed9b)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.493284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.547743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6abff0c7749473dbb81853e6b48ed9b', 'request_id': 'req-0b535280-a2cb-49d9-a33a-3924440cc75b'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.555858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6abff0c7749473dbb81853e6b48ed9b', 'request_id': 'req-0b535280-a2cb-49d9-a33a-3924440cc75b'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.556808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6af02be207344092b21d6ad3e7afeb38', 'request_id': 'req-1f912b5d-9a3c-47a0-8604-a3c11813cc48'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.564069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6abff0c7749473dbb81853e6b48ed9b', 'request_id': 'req-0b535280-a2cb-49d9-a33a-3924440cc75b'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.565531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6af02be207344092b21d6ad3e7afeb38', 'request_id': 'req-1f912b5d-9a3c-47a0-8604-a3c11813cc48'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.572524 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6af02be207344092b21d6ad3e7afeb38', 'request_id': 'req-1f912b5d-9a3c-47a0-8604-a3c11813cc48'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.575811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] The token cache is being invalidate because project c6abff0c7749473dbb81853e6b48ed9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:49.576027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.576693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0b535280-a2cb-49d9-a33a-3924440cc75b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.579015 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1284/2591] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:49 2022] DELETE /identity/v3/projects/c6abff0c7749473dbb81853e6b48ed9b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:49.584223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630b39-2bed-44ea-b34b-3f43d6dda557 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.584505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630b39-2bed-44ea-b34b-3f43d6dda557 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.584783 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630b39-2bed-44ea-b34b-3f43d6dda557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.588115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] The token cache is being invalidate because project 6af02be207344092b21d6ad3e7afeb38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:49.588115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.588789 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1f912b5d-9a3c-47a0-8604-a3c11813cc48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:49.590614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1308/2592] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:49 2022] DELETE /identity/v3/projects/6af02be207344092b21d6ad3e7afeb38 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:49.595918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121280e-8641-421f-8a5c-6ee5b07fefec None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.596200 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121280e-8641-421f-8a5c-6ee5b07fefec None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.596474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121280e-8641-421f-8a5c-6ee5b07fefec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.604754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-3a630b39-2bed-44ea-b34b-3f43d6dda557 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:49.606009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-3a630b39-2bed-44ea-b34b-3f43d6dda557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:49.614774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0121280e-8641-421f-8a5c-6ee5b07fefec None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:49.615937 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0121280e-8641-421f-8a5c-6ee5b07fefec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:49.618727 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:49.657236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:49.670214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1285/2593] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:49.678483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532797b-0e95-49a0-96d9-3bb11b326a9e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.678882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532797b-0e95-49a0-96d9-3bb11b326a9e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.679273 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532797b-0e95-49a0-96d9-3bb11b326a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.681052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1309/2594] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:49.689476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749179a-998c-4dd5-8c15-77adc53d7862 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.689767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749179a-998c-4dd5-8c15-77adc53d7862 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.690043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749179a-998c-4dd5-8c15-77adc53d7862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.699466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a532797b-0e95-49a0-96d9-3bb11b326a9e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:49.700679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a532797b-0e95-49a0-96d9-3bb11b326a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:49.708142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3749179a-998c-4dd5-8c15-77adc53d7862 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:49.709349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1286/2595] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:49.709477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3749179a-998c-4dd5-8c15-77adc53d7862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:49.713811 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532797b-0e95-49a0-96d9-3bb11b326a9e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.717347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1310/2596] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:49.721480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749179a-998c-4dd5-8c15-77adc53d7862 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.724003 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532797b-0e95-49a0-96d9-3bb11b326a9e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.729052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8f7d4-92a9-4734-814a-8b7df7169043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.729709 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8f7d4-92a9-4734-814a-8b7df7169043 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.729989 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8f7d4-92a9-4734-814a-8b7df7169043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.730294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8f7d4-92a9-4734-814a-8b7df7169043 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.731827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749179a-998c-4dd5-8c15-77adc53d7862 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.731946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8f7d4-92a9-4734-814a-8b7df7169043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:49.731946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8f7d4-92a9-4734-814a-8b7df7169043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.733277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8f7d4-92a9-4734-814a-8b7df7169043 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.736426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb60cc-6555-4a48-8267-0027ccddf155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.737071 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb60cc-6555-4a48-8267-0027ccddf155 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.737351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb60cc-6555-4a48-8267-0027ccddf155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.737627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbb60cc-6555-4a48-8267-0027ccddf155 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.738386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb60cc-6555-4a48-8267-0027ccddf155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:49.738689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb60cc-6555-4a48-8267-0027ccddf155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.740276 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbb60cc-6555-4a48-8267-0027ccddf155 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.749985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1287/2597] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:49:49.751837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8f7d4-92a9-4734-814a-8b7df7169043 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.753274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1311/2598] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:49:49.760152 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb60cc-6555-4a48-8267-0027ccddf155 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.762804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8f7d4-92a9-4734-814a-8b7df7169043 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.770153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499329c8-9a91-4395-a552-ea2f9c914989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.770748 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499329c8-9a91-4395-a552-ea2f9c914989 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.771000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbb60cc-6555-4a48-8267-0027ccddf155 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.771121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499329c8-9a91-4395-a552-ea2f9c914989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.771365 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499329c8-9a91-4395-a552-ea2f9c914989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.772076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499329c8-9a91-4395-a552-ea2f9c914989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.774467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499329c8-9a91-4395-a552-ea2f9c914989 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.776808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f667f3-a2a8-44c1-980e-b86bdeeb7e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.777499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f667f3-a2a8-44c1-980e-b86bdeeb7e7e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.777782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f667f3-a2a8-44c1-980e-b86bdeeb7e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.778060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f667f3-a2a8-44c1-980e-b86bdeeb7e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.778775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f667f3-a2a8-44c1-980e-b86bdeeb7e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.780687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f667f3-a2a8-44c1-980e-b86bdeeb7e7e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.807303 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1288/2599] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:49 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:49.807539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1312/2600] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:49 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:49.811656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499329c8-9a91-4395-a552-ea2f9c914989 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.814819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f667f3-a2a8-44c1-980e-b86bdeeb7e7e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.882342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499329c8-9a91-4395-a552-ea2f9c914989 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.882589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f667f3-a2a8-44c1-980e-b86bdeeb7e7e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.887457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86982699-5077-43ae-b0db-4e192402aa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.887748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc46907-d7ea-4c27-bd00-78de1295b7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.888127 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86982699-5077-43ae-b0db-4e192402aa4c admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.888409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86982699-5077-43ae-b0db-4e192402aa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.888521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc46907-d7ea-4c27-bd00-78de1295b7da admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.888683 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86982699-5077-43ae-b0db-4e192402aa4c admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.888797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc46907-d7ea-4c27-bd00-78de1295b7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.889143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc46907-d7ea-4c27-bd00-78de1295b7da admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.889376 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86982699-5077-43ae-b0db-4e192402aa4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.889890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc46907-d7ea-4c27-bd00-78de1295b7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.891359 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86982699-5077-43ae-b0db-4e192402aa4c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.892826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc46907-d7ea-4c27-bd00-78de1295b7da admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.917147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1289/2601] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:49 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:49.918275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86982699-5077-43ae-b0db-4e192402aa4c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.918412 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1313/2602] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:49 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:49.922148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc46907-d7ea-4c27-bd00-78de1295b7da admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.930222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86982699-5077-43ae-b0db-4e192402aa4c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.932878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc46907-d7ea-4c27-bd00-78de1295b7da admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.935116 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63332d5c-980b-447c-a985-eead64371b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.935779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332d5c-980b-447c-a985-eead64371b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.936057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332d5c-980b-447c-a985-eead64371b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.936334 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63332d5c-980b-447c-a985-eead64371b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.937055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63332d5c-980b-447c-a985-eead64371b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.937558 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116fbcd-15f0-4ca1-980b-053da09c9179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.938304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116fbcd-15f0-4ca1-980b-053da09c9179 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.938587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116fbcd-15f0-4ca1-980b-053da09c9179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.938696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63332d5c-980b-447c-a985-eead64371b52 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.938883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116fbcd-15f0-4ca1-980b-053da09c9179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.939583 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116fbcd-15f0-4ca1-980b-053da09c9179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.941211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116fbcd-15f0-4ca1-980b-053da09c9179 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.952418 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1290/2603] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:49.952632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1314/2604] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:49.953531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63332d5c-980b-447c-a985-eead64371b52 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.955260 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116fbcd-15f0-4ca1-980b-053da09c9179 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.964488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63332d5c-980b-447c-a985-eead64371b52 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.965596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116fbcd-15f0-4ca1-980b-053da09c9179 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:49.969959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc530-b5b9-4fb5-bb43-b7a1783f6aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.970669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc530-b5b9-4fb5-bb43-b7a1783f6aeb admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.970874 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68990aa-da53-4808-8ba5-51135d6d53fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:49.970987 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc530-b5b9-4fb5-bb43-b7a1783f6aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.971208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54fc530-b5b9-4fb5-bb43-b7a1783f6aeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.971528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68990aa-da53-4808-8ba5-51135d6d53fb admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:49.971812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68990aa-da53-4808-8ba5-51135d6d53fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:49.971997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fc530-b5b9-4fb5-bb43-b7a1783f6aeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.972098 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68990aa-da53-4808-8ba5-51135d6d53fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:49.972795 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68990aa-da53-4808-8ba5-51135d6d53fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:49.973497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54fc530-b5b9-4fb5-bb43-b7a1783f6aeb admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.974428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68990aa-da53-4808-8ba5-51135d6d53fb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:49.984497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1291/2605] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:49.987563 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1315/2606] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:49.989473 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc530-b5b9-4fb5-bb43-b7a1783f6aeb admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.991627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68990aa-da53-4808-8ba5-51135d6d53fb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:49.999642 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54fc530-b5b9-4fb5-bb43-b7a1783f6aeb admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.001617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68990aa-da53-4808-8ba5-51135d6d53fb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.004323 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0846bf2-491c-438d-8ca3-5dd34e305831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.005204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0846bf2-491c-438d-8ca3-5dd34e305831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.005866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0846bf2-491c-438d-8ca3-5dd34e305831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.006169 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0846bf2-491c-438d-8ca3-5dd34e305831 admin admin] PATH_INFO: `/v3/projects/ab0d39c2c2834adc8393fcec7ec4c323/users/fb6db32962204140a6d759add197d427/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.006539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559139fe-c3a2-4828-a1de-24a77fbdc2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.007404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559139fe-c3a2-4828-a1de-24a77fbdc2c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.007686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559139fe-c3a2-4828-a1de-24a77fbdc2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.007959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559139fe-c3a2-4828-a1de-24a77fbdc2c1 admin admin] PATH_INFO: `/v3/projects/735c605f1ff348859a4e9641912e10bb/users/723145a717304ac2b41f1eb7ccacdb7d/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.020747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0846bf2-491c-438d-8ca3-5dd34e305831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0d39c2c2834adc8393fcec7ec4c323, user_id=fb6db32962204140a6d759add197d427, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.023434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0846bf2-491c-438d-8ca3-5dd34e305831 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.024434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559139fe-c3a2-4828-a1de-24a77fbdc2c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735c605f1ff348859a4e9641912e10bb, user_id=723145a717304ac2b41f1eb7ccacdb7d, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.027176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559139fe-c3a2-4828-a1de-24a77fbdc2c1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.038692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1292/2607] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:49 2022] PUT /identity/v3/projects/ab0d39c2c2834adc8393fcec7ec4c323/users/fb6db32962204140a6d759add197d427/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:50.042027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1316/2608] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:49 2022] PUT /identity/v3/projects/735c605f1ff348859a4e9641912e10bb/users/723145a717304ac2b41f1eb7ccacdb7d/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:50.049564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48c6a0-d925-40fa-bea6-4c361e6032da None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.049859 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48c6a0-d925-40fa-bea6-4c361e6032da None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.050162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc48c6a0-d925-40fa-bea6-4c361e6032da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.052453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e200307-a6d9-4dc7-b58a-fd3f434c0f22 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.052747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e200307-a6d9-4dc7-b58a-fd3f434c0f22 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.053027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e200307-a6d9-4dc7-b58a-fd3f434c0f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.078486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-fc48c6a0-d925-40fa-bea6-4c361e6032da None None] MFA Rules not processed for user `fb6db32962204140a6d759add197d427`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:50.080529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fc48c6a0-d925-40fa-bea6-4c361e6032da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:50.083996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7e200307-a6d9-4dc7-b58a-fd3f434c0f22 None None] MFA Rules not processed for user `723145a717304ac2b41f1eb7ccacdb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:50.085261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7e200307-a6d9-4dc7-b58a-fd3f434c0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:50.090634 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:50.120729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:50.160782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1317/2609] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:49:50.160988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1293/2610] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:50.161116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e200307-a6d9-4dc7-b58a-fd3f434c0f22 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.169259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48c6a0-d925-40fa-bea6-4c361e6032da None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.170897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fc48c6a0-d925-40fa-bea6-4c361e6032da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:50.229105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e200307-a6d9-4dc7-b58a-fd3f434c0f22 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.232045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc48c6a0-d925-40fa-bea6-4c361e6032da None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.235330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae840e7-5057-4277-ac8e-dd4fb8795dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.236105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae840e7-5057-4277-ac8e-dd4fb8795dfc admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.236225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae1138-df61-4237-bad6-a46b3f7df8fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.236395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae840e7-5057-4277-ac8e-dd4fb8795dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.236674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae840e7-5057-4277-ac8e-dd4fb8795dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.236875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae1138-df61-4237-bad6-a46b3f7df8fb service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.237155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae1138-df61-4237-bad6-a46b3f7df8fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.237364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae840e7-5057-4277-ac8e-dd4fb8795dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.237477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae1138-df61-4237-bad6-a46b3f7df8fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.239337 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae840e7-5057-4277-ac8e-dd4fb8795dfc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.245890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae1138-df61-4237-bad6-a46b3f7df8fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.247347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae1138-df61-4237-bad6-a46b3f7df8fb service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.256910 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1294/2611] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:49:50.266361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1318/2612] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:50 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:50.271418 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae1138-df61-4237-bad6-a46b3f7df8fb service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.281844 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae1138-df61-4237-bad6-a46b3f7df8fb service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.351650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2a484-d358-41c3-b68b-dc94b3964107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.352331 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a484-d358-41c3-b68b-dc94b3964107 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.352704 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a484-d358-41c3-b68b-dc94b3964107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.352876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2a484-d358-41c3-b68b-dc94b3964107 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.353576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2a484-d358-41c3-b68b-dc94b3964107 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.357553 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2a484-d358-41c3-b68b-dc94b3964107 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.383349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1295/2613] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:50 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:50.387578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae840e7-5057-4277-ac8e-dd4fb8795dfc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.399295 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae840e7-5057-4277-ac8e-dd4fb8795dfc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.404619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b6022-3939-4e7f-bbfa-be01f60acedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.405603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b6022-3939-4e7f-bbfa-be01f60acedf admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.405963 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b6022-3939-4e7f-bbfa-be01f60acedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.406364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b6022-3939-4e7f-bbfa-be01f60acedf admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.407230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b6022-3939-4e7f-bbfa-be01f60acedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.411724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b6022-3939-4e7f-bbfa-be01f60acedf admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.431235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1319/2614] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:50.432413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2a484-d358-41c3-b68b-dc94b3964107 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.444765 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2a484-d358-41c3-b68b-dc94b3964107 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.451598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe79cf-44a5-4bc7-be9a-84c634a296be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.452613 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe79cf-44a5-4bc7-be9a-84c634a296be admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.452912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe79cf-44a5-4bc7-be9a-84c634a296be admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.453193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe79cf-44a5-4bc7-be9a-84c634a296be admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.454994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe79cf-44a5-4bc7-be9a-84c634a296be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.456624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe79cf-44a5-4bc7-be9a-84c634a296be admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.468848 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1296/2615] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:50.480426 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b6022-3939-4e7f-bbfa-be01f60acedf admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.487054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b6022-3939-4e7f-bbfa-be01f60acedf admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.492029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6ad17-f970-4a9a-993c-a4baba731bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.493030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6ad17-f970-4a9a-993c-a4baba731bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.493258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6ad17-f970-4a9a-993c-a4baba731bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.493582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6ad17-f970-4a9a-993c-a4baba731bb8 admin admin] PATH_INFO: `/v3/projects/b133ffd6e4944197bdb6677535733f87/users/4296e3b2f03941e1a3002fc9bf2aeb32/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.511627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6ad17-f970-4a9a-993c-a4baba731bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b133ffd6e4944197bdb6677535733f87, user_id=4296e3b2f03941e1a3002fc9bf2aeb32, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.517294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad6ad17-f970-4a9a-993c-a4baba731bb8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.539319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1320/2616] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:50 2022] PUT /identity/v3/projects/b133ffd6e4944197bdb6677535733f87/users/4296e3b2f03941e1a3002fc9bf2aeb32/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:50.551003 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf7bf-6f9b-41a8-a71f-b1e8faaad3be None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.551301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf7bf-6f9b-41a8-a71f-b1e8faaad3be None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.551588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabf7bf-6f9b-41a8-a71f-b1e8faaad3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.582885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-8dabf7bf-6f9b-41a8-a71f-b1e8faaad3be None None] MFA Rules not processed for user `4296e3b2f03941e1a3002fc9bf2aeb32`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:50.584329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8dabf7bf-6f9b-41a8-a71f-b1e8faaad3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:50.611039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:50.677973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1297/2617] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:50.682917 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6ad17-f970-4a9a-993c-a4baba731bb8 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.746488 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad6ad17-f970-4a9a-993c-a4baba731bb8 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.751634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc62bd-402c-4507-a37e-eec26f58be0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.752275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc62bd-402c-4507-a37e-eec26f58be0c admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.752648 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc62bd-402c-4507-a37e-eec26f58be0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.752922 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc62bd-402c-4507-a37e-eec26f58be0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.753734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc62bd-402c-4507-a37e-eec26f58be0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.756583 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc62bd-402c-4507-a37e-eec26f58be0c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.785385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1321/2618] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:50 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:50.789498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabf7bf-6f9b-41a8-a71f-b1e8faaad3be None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.802762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabf7bf-6f9b-41a8-a71f-b1e8faaad3be None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.862008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f67db2-498d-4f10-936f-9ad64f145b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.862796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f67db2-498d-4f10-936f-9ad64f145b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.863076 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f67db2-498d-4f10-936f-9ad64f145b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.863351 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f67db2-498d-4f10-936f-9ad64f145b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.864054 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f67db2-498d-4f10-936f-9ad64f145b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.865975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f67db2-498d-4f10-936f-9ad64f145b7d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.890564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1298/2619] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:50 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:50.892310 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc62bd-402c-4507-a37e-eec26f58be0c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.902859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc62bd-402c-4507-a37e-eec26f58be0c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.908236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09acdb-8dd1-4c54-b63f-ec1e44fc356f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.908919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09acdb-8dd1-4c54-b63f-ec1e44fc356f admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.909202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09acdb-8dd1-4c54-b63f-ec1e44fc356f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.909477 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09acdb-8dd1-4c54-b63f-ec1e44fc356f admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.910240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09acdb-8dd1-4c54-b63f-ec1e44fc356f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.911871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09acdb-8dd1-4c54-b63f-ec1e44fc356f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.917165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:50.924114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1322/2620] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:50.928070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f67db2-498d-4f10-936f-9ad64f145b7d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.938008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f67db2-498d-4f10-936f-9ad64f145b7d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:50.943305 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628df12a-c2a9-445e-85fa-b33baa823701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:50.944383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628df12a-c2a9-445e-85fa-b33baa823701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:50.944650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628df12a-c2a9-445e-85fa-b33baa823701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:50.944931 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628df12a-c2a9-445e-85fa-b33baa823701 admin admin] PATH_INFO: `/v3/projects/522facc1488e435e88afb08f83738ed7/users/7ff1e30ab91f40628ebff2ff7f6a11e0/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:50.961544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628df12a-c2a9-445e-85fa-b33baa823701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522facc1488e435e88afb08f83738ed7, user_id=7ff1e30ab91f40628ebff2ff7f6a11e0, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:50.964454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628df12a-c2a9-445e-85fa-b33baa823701 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:50.980295 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1299/2621] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:50 2022] PUT /identity/v3/projects/522facc1488e435e88afb08f83738ed7/users/7ff1e30ab91f40628ebff2ff7f6a11e0/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:50.984695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09acdb-8dd1-4c54-b63f-ec1e44fc356f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:50.995403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09acdb-8dd1-4c54-b63f-ec1e44fc356f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:51.066239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6536bb2-1982-4821-b367-46e8cda71604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:51.066912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6536bb2-1982-4821-b367-46e8cda71604 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:51.067196 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6536bb2-1982-4821-b367-46e8cda71604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:51.067479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6536bb2-1982-4821-b367-46e8cda71604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:51.068206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6536bb2-1982-4821-b367-46e8cda71604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:51.069808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6536bb2-1982-4821-b367-46e8cda71604 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:51.082355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1323/2622] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:51.086508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628df12a-c2a9-445e-85fa-b33baa823701 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:51.097506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628df12a-c2a9-445e-85fa-b33baa823701 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:51.102281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeae7f-1bb3-48a2-81b3-029b2d44bb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:51.103158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeae7f-1bb3-48a2-81b3-029b2d44bb85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:51.103445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeae7f-1bb3-48a2-81b3-029b2d44bb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:51.103725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daeae7f-1bb3-48a2-81b3-029b2d44bb85 admin admin] PATH_INFO: `/v3/projects/522facc1488e435e88afb08f83738ed7/users/7ff1e30ab91f40628ebff2ff7f6a11e0/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:51.105749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeae7f-1bb3-48a2-81b3-029b2d44bb85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522facc1488e435e88afb08f83738ed7, user_id=7ff1e30ab91f40628ebff2ff7f6a11e0, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:51.109108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daeae7f-1bb3-48a2-81b3-029b2d44bb85 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:51.120857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1300/2623] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:51 2022] PUT /identity/v3/projects/522facc1488e435e88afb08f83738ed7/users/7ff1e30ab91f40628ebff2ff7f6a11e0/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:51.133262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6228d-7170-42e4-9f0a-33bd6a729812 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:51.133614 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6228d-7170-42e4-9f0a-33bd6a729812 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:51.134032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6228d-7170-42e4-9f0a-33bd6a729812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:51.163268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-37b6228d-7170-42e4-9f0a-33bd6a729812 None None] MFA Rules not processed for user `7ff1e30ab91f40628ebff2ff7f6a11e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:51.164793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-37b6228d-7170-42e4-9f0a-33bd6a729812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:51.232664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1324/2624] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:51.245602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeae7f-1bb3-48a2-81b3-029b2d44bb85 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:51.310746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daeae7f-1bb3-48a2-81b3-029b2d44bb85 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:51.315146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bbb08-afb2-4575-93b0-764dc56ec7fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:51.315789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bbb08-afb2-4575-93b0-764dc56ec7fb service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:51.316069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bbb08-afb2-4575-93b0-764dc56ec7fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:51.316343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bbb08-afb2-4575-93b0-764dc56ec7fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:51.325363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bbb08-afb2-4575-93b0-764dc56ec7fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:51.326816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bbb08-afb2-4575-93b0-764dc56ec7fb service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:51.336289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1301/2625] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:51.936753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6228d-7170-42e4-9f0a-33bd6a729812 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:51.938453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-37b6228d-7170-42e4-9f0a-33bd6a729812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:51.951873 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6228d-7170-42e4-9f0a-33bd6a729812 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:51.956273 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609052e-244b-4d68-b477-0426c506525a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:51.957001 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609052e-244b-4d68-b477-0426c506525a service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:51.957290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609052e-244b-4d68-b477-0426c506525a service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:51.957571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609052e-244b-4d68-b477-0426c506525a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:52.001440 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bbb08-afb2-4575-93b0-764dc56ec7fb service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:52.003336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0b2bbb08-afb2-4575-93b0-764dc56ec7fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:52.026221 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609052e-244b-4d68-b477-0426c506525a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:52.027939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609052e-244b-4d68-b477-0426c506525a service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:52.029183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:52.038732 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1325/2626] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:52.081814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bbb08-afb2-4575-93b0-764dc56ec7fb service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:52.087300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:52.088991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:52.088991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:52.089349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] PATH_INFO: `/v3/users/ec962ee0b8584dafbc6f49d99c03999c` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:52.091779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec962ee0b8584dafbc6f49d99c03999c)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:52.093712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:52.144772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec962ee0b8584dafbc6f49d99c03999c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.145342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec962ee0b8584dafbc6f49d99c03999c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.145943 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec962ee0b8584dafbc6f49d99c03999c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.159845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec962ee0b8584dafbc6f49d99c03999c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.166979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec962ee0b8584dafbc6f49d99c03999c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.182508 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1302/2627] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:52 2022] DELETE /identity/v3/users/ec962ee0b8584dafbc6f49d99c03999c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:52.188414 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576415-6652-4f4f-bd3f-c7a0c23f7cf2 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:52.188784 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576415-6652-4f4f-bd3f-c7a0c23f7cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:52.189062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22576415-6652-4f4f-bd3f-c7a0c23f7cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:52.207055 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-22576415-6652-4f4f-bd3f-c7a0c23f7cf2 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:52.208271 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-22576415-6652-4f4f-bd3f-c7a0c23f7cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:52.222325 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:52.274620 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1326/2628] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:52.287883 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:52.289783 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:52.375981 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b0ba6-a68f-43e7-8dfd-8a721c5329e6 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:52.379684 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f8b7d-631a-4170-a2ae-ad52ff48c938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:52.380343 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f8b7d-631a-4170-a2ae-ad52ff48c938 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:52.380905 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f8b7d-631a-4170-a2ae-ad52ff48c938 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:52.381178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f8b7d-631a-4170-a2ae-ad52ff48c938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:52.392139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f8b7d-631a-4170-a2ae-ad52ff48c938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:52.393611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f8b7d-631a-4170-a2ae-ad52ff48c938 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:52.404028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1303/2629] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:52.679930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22576415-6652-4f4f-bd3f-c7a0c23f7cf2 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:52.681382 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-22576415-6652-4f4f-bd3f-c7a0c23f7cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:52.697288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22576415-6652-4f4f-bd3f-c7a0c23f7cf2 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:52.702777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:52.703851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:52.704141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:52.704416 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] PATH_INFO: `/v3/projects/d4094ed827e64ebea06da9b9647dea59` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:52.705635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4094ed827e64ebea06da9b9647dea59)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:52.708450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:52.758907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4094ed827e64ebea06da9b9647dea59', 'request_id': 'req-690d34fe-f394-4712-997f-08ef9cadbafd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.767783 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4094ed827e64ebea06da9b9647dea59', 'request_id': 'req-690d34fe-f394-4712-997f-08ef9cadbafd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.774912 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4094ed827e64ebea06da9b9647dea59', 'request_id': 'req-690d34fe-f394-4712-997f-08ef9cadbafd'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.785631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] The token cache is being invalidate because project d4094ed827e64ebea06da9b9647dea59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:52.785914 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.786578 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.788123 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1327/2630] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:52 2022] DELETE /identity/v3/projects/d4094ed827e64ebea06da9b9647dea59 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:52.792513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f8b7d-631a-4170-a2ae-ad52ff48c938 service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:52.802860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f8b7d-631a-4170-a2ae-ad52ff48c938 service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:52.836426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:52.862456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:52.863338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:52.863619 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:52.863896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] PATH_INFO: `/v3/users/bbc39781f6104e79ba92ff360a6fc99f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:52.865090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc39781f6104e79ba92ff360a6fc99f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:52.867097 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:52.910267 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:52.912042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:52.920355 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc39781f6104e79ba92ff360a6fc99f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.921596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc39781f6104e79ba92ff360a6fc99f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.922903 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc39781f6104e79ba92ff360a6fc99f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.925487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d34fe-f394-4712-997f-08ef9cadbafd admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:52.931166 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:52.932184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:52.932473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:52.932749 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] PATH_INFO: `/v3/users/723145a717304ac2b41f1eb7ccacdb7d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:52.934119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] RBAC: Authorizing `identity:delete_user(user_id=723145a717304ac2b41f1eb7ccacdb7d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:52.935431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc39781f6104e79ba92ff360a6fc99f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.936576 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:52.942380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-9cb3f7c1-7701-4d78-a99e-66ddb2bb68f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc39781f6104e79ba92ff360a6fc99f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.955330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1304/2631] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:52 2022] DELETE /identity/v3/users/bbc39781f6104e79ba92ff360a6fc99f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:52.986490 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723145a717304ac2b41f1eb7ccacdb7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.994497 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723145a717304ac2b41f1eb7ccacdb7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:52.995239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723145a717304ac2b41f1eb7ccacdb7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.008363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723145a717304ac2b41f1eb7ccacdb7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.017546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723145a717304ac2b41f1eb7ccacdb7d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.025104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1328/2632] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:52 2022] DELETE /identity/v3/users/723145a717304ac2b41f1eb7ccacdb7d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:53.029587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a1a46-73a5-4aad-8405-53ebd7ad2852 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.030161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a1a46-73a5-4aad-8405-53ebd7ad2852 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.030161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a1a46-73a5-4aad-8405-53ebd7ad2852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.048214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-ac2a1a46-73a5-4aad-8405-53ebd7ad2852 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:53.049445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ac2a1a46-73a5-4aad-8405-53ebd7ad2852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:53.112256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1305/2633] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:53.124770 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:53.126263 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:53.145330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:53.188970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69839ff4-9a41-400a-8ab3-b4ab39ec9670 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:53.192719 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a9d7c6-0178-4650-bea1-13e045100596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:53.193363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d7c6-0178-4650-bea1-13e045100596 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.193658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d7c6-0178-4650-bea1-13e045100596 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.193928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a9d7c6-0178-4650-bea1-13e045100596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.203842 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9d7c6-0178-4650-bea1-13e045100596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:53.205315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a9d7c6-0178-4650-bea1-13e045100596 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:53.215394 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1329/2634] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:53.239817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a1a46-73a5-4aad-8405-53ebd7ad2852 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:53.241870 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ac2a1a46-73a5-4aad-8405-53ebd7ad2852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:53.263058 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a1a46-73a5-4aad-8405-53ebd7ad2852 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:53.269729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:53.271488 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.271940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.272439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] PATH_INFO: `/v3/projects/267914388d1d47c686b1d79764598641` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.273927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=267914388d1d47c686b1d79764598641)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:53.276322 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:53.327963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '267914388d1d47c686b1d79764598641', 'request_id': 'req-e3653ad7-e876-4818-b7e8-8c62a7690d0e'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.331607 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:53.343340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '267914388d1d47c686b1d79764598641', 'request_id': 'req-e3653ad7-e876-4818-b7e8-8c62a7690d0e'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.359150 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '267914388d1d47c686b1d79764598641', 'request_id': 'req-e3653ad7-e876-4818-b7e8-8c62a7690d0e'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.378930 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] The token cache is being invalidate because project 267914388d1d47c686b1d79764598641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:53.379230 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.380154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e3653ad7-e876-4818-b7e8-8c62a7690d0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.385995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1306/2635] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:53 2022] DELETE /identity/v3/projects/267914388d1d47c686b1d79764598641 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:53.389365 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9936840-2dc6-4d57-aef3-937e67ebe10b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.389657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9936840-2dc6-4d57-aef3-937e67ebe10b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.390141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9936840-2dc6-4d57-aef3-937e67ebe10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.414987 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f9936840-2dc6-4d57-aef3-937e67ebe10b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:53.416201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f9936840-2dc6-4d57-aef3-937e67ebe10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:53.510328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1330/2636] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:53.521443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a87b-c97b-4238-a5ca-3e19b0640c95 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.521733 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a87b-c97b-4238-a5ca-3e19b0640c95 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.521997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a87b-c97b-4238-a5ca-3e19b0640c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.545662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9936840-2dc6-4d57-aef3-937e67ebe10b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:53.548901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f9936840-2dc6-4d57-aef3-937e67ebe10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:53.563613 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-8a56a87b-c97b-4238-a5ca-3e19b0640c95 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:53.565389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8a56a87b-c97b-4238-a5ca-3e19b0640c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:53.581036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9936840-2dc6-4d57-aef3-937e67ebe10b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:53.581731 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1307/2637] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:53.586856 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:53.587667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56a87b-c97b-4238-a5ca-3e19b0640c95 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:53.588040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.588420 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.588766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] PATH_INFO: `/v3/projects/735c605f1ff348859a4e9641912e10bb` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.590949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=735c605f1ff348859a4e9641912e10bb)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:53.593368 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:53.599160 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56a87b-c97b-4238-a5ca-3e19b0640c95 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:53.607472 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d582ff8-65d7-409c-8b06-284313aec1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:53.608404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d582ff8-65d7-409c-8b06-284313aec1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.608581 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d582ff8-65d7-409c-8b06-284313aec1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.608741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d582ff8-65d7-409c-8b06-284313aec1fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.609505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d582ff8-65d7-409c-8b06-284313aec1fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:53.609812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d582ff8-65d7-409c-8b06-284313aec1fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:53.612268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d582ff8-65d7-409c-8b06-284313aec1fd admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:53.630409 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1308/2638] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:49:53.632932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d582ff8-65d7-409c-8b06-284313aec1fd admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:53.646422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d582ff8-65d7-409c-8b06-284313aec1fd admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:53.660795 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735c605f1ff348859a4e9641912e10bb', 'request_id': 'req-4e0fcb19-3f99-4255-b2e6-0d69231516ea'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.670133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735c605f1ff348859a4e9641912e10bb', 'request_id': 'req-4e0fcb19-3f99-4255-b2e6-0d69231516ea'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.678004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735c605f1ff348859a4e9641912e10bb', 'request_id': 'req-4e0fcb19-3f99-4255-b2e6-0d69231516ea'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.693216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] The token cache is being invalidate because project 735c605f1ff348859a4e9641912e10bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:53.693540 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.694241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:53.696537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1331/2639] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:53 2022] DELETE /identity/v3/projects/735c605f1ff348859a4e9641912e10bb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:53.729533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcef06-258a-442c-bd82-5f2c4c1a8758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:53.731154 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcef06-258a-442c-bd82-5f2c4c1a8758 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.731656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcef06-258a-442c-bd82-5f2c4c1a8758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.732024 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcef06-258a-442c-bd82-5f2c4c1a8758 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.732886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcef06-258a-442c-bd82-5f2c4c1a8758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:53.735721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcef06-258a-442c-bd82-5f2c4c1a8758 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:53.778926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1309/2640] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:53 2022] POST /identity/v3/projects => generated 361 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:53.780595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:53.782879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:53.799131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fcb19-3f99-4255-b2e6-0d69231516ea admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:53.857689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:53.881029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c1779-f829-4c4e-af34-bd219b7a4680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:53.882205 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c1779-f829-4c4e-af34-bd219b7a4680 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.882664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c1779-f829-4c4e-af34-bd219b7a4680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.883107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c1779-f829-4c4e-af34-bd219b7a4680 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.884404 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c1779-f829-4c4e-af34-bd219b7a4680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:53.888228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c1779-f829-4c4e-af34-bd219b7a4680 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:53.916931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1332/2641] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:53 2022] POST /identity/v3/users => generated 281 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:53.921384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcef06-258a-442c-bd82-5f2c4c1a8758 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:53.933284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcef06-258a-442c-bd82-5f2c4c1a8758 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:53.938530 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90b638-b864-4df1-aa42-25e5b9c47b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:53.939319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b638-b864-4df1-aa42-25e5b9c47b87 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.939678 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b638-b864-4df1-aa42-25e5b9c47b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.940023 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a90b638-b864-4df1-aa42-25e5b9c47b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.940867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90b638-b864-4df1-aa42-25e5b9c47b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:53.942630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a90b638-b864-4df1-aa42-25e5b9c47b87 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:53.953974 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1310/2642] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:53.958064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c1779-f829-4c4e-af34-bd219b7a4680 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:53.968301 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c1779-f829-4c4e-af34-bd219b7a4680 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:53.973525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61aab18-573d-421e-b733-d3c873cbe971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:53.974217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aab18-573d-421e-b733-d3c873cbe971 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:53.974502 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aab18-573d-421e-b733-d3c873cbe971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:53.974806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61aab18-573d-421e-b733-d3c873cbe971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:53.975537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aab18-573d-421e-b733-d3c873cbe971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:53.977137 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61aab18-573d-421e-b733-d3c873cbe971 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:53.987073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1333/2643] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:53.991293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90b638-b864-4df1-aa42-25e5b9c47b87 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:54.001384 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a90b638-b864-4df1-aa42-25e5b9c47b87 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:54.006839 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efaf2a-9f24-4efe-89cc-098bd6c4c7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:54.007717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efaf2a-9f24-4efe-89cc-098bd6c4c7f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:54.007996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efaf2a-9f24-4efe-89cc-098bd6c4c7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:54.008268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33efaf2a-9f24-4efe-89cc-098bd6c4c7f3 admin admin] PATH_INFO: `/v3/projects/89bbe9582aa44af1bcb827b9cbfd57bb/users/c3da21dda6564575811311d2ec841615/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:54.023344 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efaf2a-9f24-4efe-89cc-098bd6c4c7f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89bbe9582aa44af1bcb827b9cbfd57bb, user_id=c3da21dda6564575811311d2ec841615, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:54.025979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33efaf2a-9f24-4efe-89cc-098bd6c4c7f3 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:54.039695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1311/2644] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:53 2022] PUT /identity/v3/projects/89bbe9582aa44af1bcb827b9cbfd57bb/users/c3da21dda6564575811311d2ec841615/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:54.050005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbd04-efed-43b3-b897-441526cbb5c4 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:54.050327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbd04-efed-43b3-b897-441526cbb5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:54.050603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbd04-efed-43b3-b897-441526cbb5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:54.077296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d33cbd04-efed-43b3-b897-441526cbb5c4 None None] MFA Rules not processed for user `c3da21dda6564575811311d2ec841615`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:54.079045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d33cbd04-efed-43b3-b897-441526cbb5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:54.143110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1334/2645] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:54.174507 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efaf2a-9f24-4efe-89cc-098bd6c4c7f3 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:54.176267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-33efaf2a-9f24-4efe-89cc-098bd6c4c7f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:54.240994 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33efaf2a-9f24-4efe-89cc-098bd6c4c7f3 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:54.244712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935ba986-11e9-4944-bf64-47be13968a92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:54.245352 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ba986-11e9-4944-bf64-47be13968a92 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:54.245632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ba986-11e9-4944-bf64-47be13968a92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:54.245906 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935ba986-11e9-4944-bf64-47be13968a92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:54.254342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ba986-11e9-4944-bf64-47be13968a92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:54.256029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935ba986-11e9-4944-bf64-47be13968a92 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:54.264703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1312/2646] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:54.279255 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cbd04-efed-43b3-b897-441526cbb5c4 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:54.346928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cbd04-efed-43b3-b897-441526cbb5c4 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:54.351571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:54.352460 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:54.352744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:54.353048 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] PATH_INFO: `/v3/users/c3da21dda6564575811311d2ec841615` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:54.354305 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3da21dda6564575811311d2ec841615)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:54.356293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:54.403802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3da21dda6564575811311d2ec841615'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:54.407387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:54.412511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3da21dda6564575811311d2ec841615'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:54.413526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3da21dda6564575811311d2ec841615'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:54.427500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3da21dda6564575811311d2ec841615'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:54.434449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3da21dda6564575811311d2ec841615'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:54.441029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1335/2647] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:54 2022] DELETE /identity/v3/users/c3da21dda6564575811311d2ec841615 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:54.445544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d54aa-feff-4971-837c-7d473f745e02 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:54.445830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d54aa-feff-4971-837c-7d473f745e02 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:54.446137 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d54aa-feff-4971-837c-7d473f745e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:54.463702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-803d54aa-feff-4971-837c-7d473f745e02 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:54.464993 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-803d54aa-feff-4971-837c-7d473f745e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:54.473437 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:54.527656 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1313/2648] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:54.537240 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:54.538686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:54.598061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af3565-53df-4fcb-a6c4-805a75072bbe admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:54.601805 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d4bf3f-20fa-43a4-a525-3a1a6521df47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:54.602487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4bf3f-20fa-43a4-a525-3a1a6521df47 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:54.602765 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4bf3f-20fa-43a4-a525-3a1a6521df47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:54.603038 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d4bf3f-20fa-43a4-a525-3a1a6521df47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:54.612780 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4bf3f-20fa-43a4-a525-3a1a6521df47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:54.614265 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d4bf3f-20fa-43a4-a525-3a1a6521df47 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:54.627702 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1336/2649] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:54.949889 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d54aa-feff-4971-837c-7d473f745e02 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:54.951915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-803d54aa-feff-4971-837c-7d473f745e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:54.978386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d54aa-feff-4971-837c-7d473f745e02 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:54.983673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:54.985188 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:54.985549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:54.985896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] PATH_INFO: `/v3/projects/89bbe9582aa44af1bcb827b9cbfd57bb` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:54.987347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89bbe9582aa44af1bcb827b9cbfd57bb)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:54.989353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:55.042356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89bbe9582aa44af1bcb827b9cbfd57bb', 'request_id': 'req-b86d06e2-7ce6-4360-b8d8-76264658bf33'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:55.051301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89bbe9582aa44af1bcb827b9cbfd57bb', 'request_id': 'req-b86d06e2-7ce6-4360-b8d8-76264658bf33'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:55.059159 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89bbe9582aa44af1bcb827b9cbfd57bb', 'request_id': 'req-b86d06e2-7ce6-4360-b8d8-76264658bf33'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:55.072128 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] The token cache is being invalidate because project 89bbe9582aa44af1bcb827b9cbfd57bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:55.072263 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:55.073085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-b86d06e2-7ce6-4360-b8d8-76264658bf33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:55.074570 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1314/2650] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:54 2022] DELETE /identity/v3/projects/89bbe9582aa44af1bcb827b9cbfd57bb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:55.079639 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d3d04-b166-4ba5-ada3-69e6f18f8aae None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:55.080095 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d3d04-b166-4ba5-ada3-69e6f18f8aae None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:55.080209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0d3d04-b166-4ba5-ada3-69e6f18f8aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:55.099759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1b0d3d04-b166-4ba5-ada3-69e6f18f8aae None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:55.101032 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1b0d3d04-b166-4ba5-ada3-69e6f18f8aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:55.162401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1337/2651] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:55.171170 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d7d2b-3139-4765-81c9-29db0401127f None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:55.171524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d7d2b-3139-4765-81c9-29db0401127f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:55.171729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01d7d2b-3139-4765-81c9-29db0401127f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:55.191789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-d01d7d2b-3139-4765-81c9-29db0401127f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:55.193196 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-d01d7d2b-3139-4765-81c9-29db0401127f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:55.201783 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1315/2652] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:55.206977 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d3d04-b166-4ba5-ada3-69e6f18f8aae None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:55.216746 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0d3d04-b166-4ba5-ada3-69e6f18f8aae None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:55.221881 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5da1d-16e0-49e3-a266-6d711033bc41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:55.222566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5da1d-16e0-49e3-a266-6d711033bc41 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:55.222843 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5da1d-16e0-49e3-a266-6d711033bc41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:55.223115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5da1d-16e0-49e3-a266-6d711033bc41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:55.223827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5da1d-16e0-49e3-a266-6d711033bc41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:49:55.224127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5da1d-16e0-49e3-a266-6d711033bc41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:55.225727 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5da1d-16e0-49e3-a266-6d711033bc41 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:55.241423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1338/2653] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:49:55.242583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d7d2b-3139-4765-81c9-29db0401127f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:55.251869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01d7d2b-3139-4765-81c9-29db0401127f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:55.256755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca2413-df0e-421d-8c0b-cbf6f7782632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:55.257405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2413-df0e-421d-8c0b-cbf6f7782632 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:55.257690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2413-df0e-421d-8c0b-cbf6f7782632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:55.257968 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca2413-df0e-421d-8c0b-cbf6f7782632 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:55.258763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca2413-df0e-421d-8c0b-cbf6f7782632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:55.260663 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca2413-df0e-421d-8c0b-cbf6f7782632 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:55.286092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1316/2654] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:49:55 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:49:55.290444 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5da1d-16e0-49e3-a266-6d711033bc41 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:55.301288 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5da1d-16e0-49e3-a266-6d711033bc41 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:55.359087 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f4145-7f68-42b3-bdc0-dfdc96e62efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:55.360485 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f4145-7f68-42b3-bdc0-dfdc96e62efe admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:55.360767 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f4145-7f68-42b3-bdc0-dfdc96e62efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:55.361039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761f4145-7f68-42b3-bdc0-dfdc96e62efe admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:55.361725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f4145-7f68-42b3-bdc0-dfdc96e62efe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:55.363659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761f4145-7f68-42b3-bdc0-dfdc96e62efe admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:55.370233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:55.384356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1339/2655] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:49:55 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:49:55.388927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca2413-df0e-421d-8c0b-cbf6f7782632 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:55.399476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca2413-df0e-421d-8c0b-cbf6f7782632 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:55.404630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a729f-542e-4bb6-a123-f8c81490d80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:55.405306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a729f-542e-4bb6-a123-f8c81490d80d admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:55.405590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a729f-542e-4bb6-a123-f8c81490d80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:55.405861 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a729f-542e-4bb6-a123-f8c81490d80d admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:55.407142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a729f-542e-4bb6-a123-f8c81490d80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:55.408722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2a729f-542e-4bb6-a123-f8c81490d80d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:55.418949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1317/2656] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:49:55.423585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f4145-7f68-42b3-bdc0-dfdc96e62efe admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:55.433707 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761f4145-7f68-42b3-bdc0-dfdc96e62efe admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:55.438458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22235668-2db3-4f14-8589-8012cf0479fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:55.439108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235668-2db3-4f14-8589-8012cf0479fb admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:55.439418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235668-2db3-4f14-8589-8012cf0479fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:55.439701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22235668-2db3-4f14-8589-8012cf0479fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:55.440457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235668-2db3-4f14-8589-8012cf0479fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:55.442057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22235668-2db3-4f14-8589-8012cf0479fb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:55.451850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1340/2657] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:49:55.456247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a729f-542e-4bb6-a123-f8c81490d80d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:55.466163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a729f-542e-4bb6-a123-f8c81490d80d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:55.471398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11c4a4-780b-4420-9bcd-84b017454f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:55.472267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11c4a4-780b-4420-9bcd-84b017454f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:55.472548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11c4a4-780b-4420-9bcd-84b017454f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:55.472822 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a11c4a4-780b-4420-9bcd-84b017454f5d admin admin] PATH_INFO: `/v3/projects/e3ba8a4f283e4c00a06d03a03d61a99e/users/459ebbe3a8214441b13bea68e445f4e8/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:55.488245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11c4a4-780b-4420-9bcd-84b017454f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ba8a4f283e4c00a06d03a03d61a99e, user_id=459ebbe3a8214441b13bea68e445f4e8, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:55.490934 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a11c4a4-780b-4420-9bcd-84b017454f5d admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:55.504212 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1318/2658] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:49:55 2022] PUT /identity/v3/projects/e3ba8a4f283e4c00a06d03a03d61a99e/users/459ebbe3a8214441b13bea68e445f4e8/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:55.519308 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c067af-ba92-402c-83f1-ec8b356143fd None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:55.519598 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c067af-ba92-402c-83f1-ec8b356143fd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:55.519877 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c067af-ba92-402c-83f1-ec8b356143fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:55.546362 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-b2c067af-ba92-402c-83f1-ec8b356143fd None None] MFA Rules not processed for user `459ebbe3a8214441b13bea68e445f4e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:55.547483 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b2c067af-ba92-402c-83f1-ec8b356143fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:55.616526 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1341/2659] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:55.628435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11c4a4-780b-4420-9bcd-84b017454f5d admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:55.630195 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9a11c4a4-780b-4420-9bcd-84b017454f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:55.678788 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:55.704086 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a11c4a4-780b-4420-9bcd-84b017454f5d admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:55.707791 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d08ae-e729-4731-8cfc-f4fd07fd826a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:55.708515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d08ae-e729-4731-8cfc-f4fd07fd826a service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:55.708718 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d08ae-e729-4731-8cfc-f4fd07fd826a service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:55.708983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d08ae-e729-4731-8cfc-f4fd07fd826a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:55.720307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d08ae-e729-4731-8cfc-f4fd07fd826a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:55.721763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435d08ae-e729-4731-8cfc-f4fd07fd826a service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:55.733429 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1319/2660] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:56.203027 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c067af-ba92-402c-83f1-ec8b356143fd None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:56.212712 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c067af-ba92-402c-83f1-ec8b356143fd None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:56.216446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2cb615-f489-4324-b15c-ef988976c838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:56.217114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb615-f489-4324-b15c-ef988976c838 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:56.217373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb615-f489-4324-b15c-ef988976c838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:56.217801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2cb615-f489-4324-b15c-ef988976c838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:56.219747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5f2cb615-f489-4324-b15c-ef988976c838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:56.278970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cb615-f489-4324-b15c-ef988976c838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:56.280424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2cb615-f489-4324-b15c-ef988976c838 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:56.289643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1342/2661] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:58.378199 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d08ae-e729-4731-8cfc-f4fd07fd826a service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:58.379712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-435d08ae-e729-4731-8cfc-f4fd07fd826a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:58.451131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d08ae-e729-4731-8cfc-f4fd07fd826a service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:58.457090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:58.458276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:58.458585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:58.458897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] PATH_INFO: `/v3/users/fb6db32962204140a6d759add197d427` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:58.462949 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb6db32962204140a6d759add197d427)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:58.465043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:58.524267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb6db32962204140a6d759add197d427'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:58.524958 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb6db32962204140a6d759add197d427'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:58.525620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb6db32962204140a6d759add197d427'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:58.538143 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb6db32962204140a6d759add197d427'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:58.544964 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb6db32962204140a6d759add197d427'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:58.558755 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1320/2662] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:58 2022] DELETE /identity/v3/users/fb6db32962204140a6d759add197d427 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:58.563355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa483471-572b-4bdd-b6e5-38c79f2ef85d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:58.563849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa483471-572b-4bdd-b6e5-38c79f2ef85d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:58.563978 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa483471-572b-4bdd-b6e5-38c79f2ef85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:58.581927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-fa483471-572b-4bdd-b6e5-38c79f2ef85d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:49:58.583168 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fa483471-572b-4bdd-b6e5-38c79f2ef85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:58.654871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1343/2663] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:49:58.665043 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:58.666573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:58.725867 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dcc1e5-cf00-4a9d-b3d2-871c3d93c5c4 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:58.729492 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68ec0f-7938-4f8d-a23e-b32c807f227c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:58.730164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68ec0f-7938-4f8d-a23e-b32c807f227c service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:58.730447 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68ec0f-7938-4f8d-a23e-b32c807f227c service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:58.730721 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68ec0f-7938-4f8d-a23e-b32c807f227c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:58.739779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68ec0f-7938-4f8d-a23e-b32c807f227c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:58.741205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f68ec0f-7938-4f8d-a23e-b32c807f227c service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:58.748008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:58.753395 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1321/2664] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:49:59.046957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa483471-572b-4bdd-b6e5-38c79f2ef85d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:59.048202 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fa483471-572b-4bdd-b6e5-38c79f2ef85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:59.064821 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa483471-572b-4bdd-b6e5-38c79f2ef85d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:59.071592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:59.072552 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:59.072940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:59.073238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] PATH_INFO: `/v3/projects/ab0d39c2c2834adc8393fcec7ec4c323` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:59.074852 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0d39c2c2834adc8393fcec7ec4c323)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:59.076710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:59.079093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:59.132172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0d39c2c2834adc8393fcec7ec4c323', 'request_id': 'req-35771d97-c037-48ae-a820-ee6a43f572cb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.139651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0d39c2c2834adc8393fcec7ec4c323', 'request_id': 'req-35771d97-c037-48ae-a820-ee6a43f572cb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.147222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0d39c2c2834adc8393fcec7ec4c323', 'request_id': 'req-35771d97-c037-48ae-a820-ee6a43f572cb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.158179 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] The token cache is being invalidate because project ab0d39c2c2834adc8393fcec7ec4c323 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:59.158473 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.159127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.160686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1344/2665] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:59 2022] DELETE /identity/v3/projects/ab0d39c2c2834adc8393fcec7ec4c323 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:49:59.164726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68ec0f-7938-4f8d-a23e-b32c807f227c service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:59.175658 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f68ec0f-7938-4f8d-a23e-b32c807f227c service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:59.240148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:59.241039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:59.241325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:59.241606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] PATH_INFO: `/v3/users/4296e3b2f03941e1a3002fc9bf2aeb32` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:59.243084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4296e3b2f03941e1a3002fc9bf2aeb32)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:59.245042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:59.296069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4296e3b2f03941e1a3002fc9bf2aeb32'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.297270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4296e3b2f03941e1a3002fc9bf2aeb32'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.298052 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4296e3b2f03941e1a3002fc9bf2aeb32'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.312010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4296e3b2f03941e1a3002fc9bf2aeb32'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.320090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4296e3b2f03941e1a3002fc9bf2aeb32'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.338324 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1322/2666] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:59 2022] DELETE /identity/v3/users/4296e3b2f03941e1a3002fc9bf2aeb32 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:59.638580 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:59.641400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:59.668067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35771d97-c037-48ae-a820-ee6a43f572cb admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:59.737377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:59.738278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:59.738564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:59.738837 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] PATH_INFO: `/v3/projects/b133ffd6e4944197bdb6677535733f87` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:59.740017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b133ffd6e4944197bdb6677535733f87)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:59.741929 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:59.789566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b133ffd6e4944197bdb6677535733f87', 'request_id': 'req-44106d11-c42e-48fd-b323-2d01fbe27421'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.798484 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b133ffd6e4944197bdb6677535733f87', 'request_id': 'req-44106d11-c42e-48fd-b323-2d01fbe27421'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.805119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b133ffd6e4944197bdb6677535733f87', 'request_id': 'req-44106d11-c42e-48fd-b323-2d01fbe27421'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.815351 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] The token cache is being invalidate because project b133ffd6e4944197bdb6677535733f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:49:59.815632 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.817455 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.818033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1345/2667] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:49:59 2022] DELETE /identity/v3/projects/b133ffd6e4944197bdb6677535733f87 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:49:59.822364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:49:59.823766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:49:59.836572 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38196f77-2f51-4754-8cf3-9e504c6347a1 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:49:59.904068 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:49:59.905790 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:49:59.906806 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:49:59.907445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] PATH_INFO: `/v3/users/7ff1e30ab91f40628ebff2ff7f6a11e0` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:49:59.909835 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff1e30ab91f40628ebff2ff7f6a11e0)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:49:59.911996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:49:59.934986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:49:59.964269 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff1e30ab91f40628ebff2ff7f6a11e0'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.964941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff1e30ab91f40628ebff2ff7f6a11e0'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.965679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff1e30ab91f40628ebff2ff7f6a11e0'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.978533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff1e30ab91f40628ebff2ff7f6a11e0'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:49:59.986281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-13c11f77-5ea5-4342-8934-de65e4f6bf39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff1e30ab91f40628ebff2ff7f6a11e0'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:00.007516 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1323/2668] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:49:59 2022] DELETE /identity/v3/users/7ff1e30ab91f40628ebff2ff7f6a11e0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:00.303584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:00.305902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:00.332528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44106d11-c42e-48fd-b323-2d01fbe27421 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:00.353204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:00.404191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:00.405069 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.405352 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.405724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] PATH_INFO: `/v3/projects/522facc1488e435e88afb08f83738ed7` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.407836 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522facc1488e435e88afb08f83738ed7)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:00.409858 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:00.471257 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522facc1488e435e88afb08f83738ed7', 'request_id': 'req-2afe937c-af28-42ba-9d5c-89befea84192'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:00.480246 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522facc1488e435e88afb08f83738ed7', 'request_id': 'req-2afe937c-af28-42ba-9d5c-89befea84192'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:00.487464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522facc1488e435e88afb08f83738ed7', 'request_id': 'req-2afe937c-af28-42ba-9d5c-89befea84192'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:00.498131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] The token cache is being invalidate because project 522facc1488e435e88afb08f83738ed7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:00.498809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:00.499564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-2afe937c-af28-42ba-9d5c-89befea84192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:00.506459 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1346/2669] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:00 2022] DELETE /identity/v3/projects/522facc1488e435e88afb08f83738ed7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:00.507605 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78028203-4397-421d-8cc5-2edce2e8bc89 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.507967 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78028203-4397-421d-8cc5-2edce2e8bc89 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.508249 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78028203-4397-421d-8cc5-2edce2e8bc89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.528260 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-78028203-4397-421d-8cc5-2edce2e8bc89 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:00.529595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-78028203-4397-421d-8cc5-2edce2e8bc89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:00.610487 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1324/2670] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:00.618311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5524c1-d0ed-49b6-9f13-a5702381f2b8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.618633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5524c1-d0ed-49b6-9f13-a5702381f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.618916 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5524c1-d0ed-49b6-9f13-a5702381f2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.639499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ce5524c1-d0ed-49b6-9f13-a5702381f2b8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:00.640832 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ce5524c1-d0ed-49b6-9f13-a5702381f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:00.649080 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1347/2671] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:00.653380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78028203-4397-421d-8cc5-2edce2e8bc89 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:00.663744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78028203-4397-421d-8cc5-2edce2e8bc89 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:00.668215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cb277-d031-4085-8f78-63f5f60e341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:00.669094 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb277-d031-4085-8f78-63f5f60e341a admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.669427 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb277-d031-4085-8f78-63f5f60e341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.669575 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb277-d031-4085-8f78-63f5f60e341a admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.670200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cb277-d031-4085-8f78-63f5f60e341a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:50:00.670504 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cb277-d031-4085-8f78-63f5f60e341a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:00.672740 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8cb277-d031-4085-8f78-63f5f60e341a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:00.684435 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1325/2672] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:50:00.688792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5524c1-d0ed-49b6-9f13-a5702381f2b8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:00.698216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5524c1-d0ed-49b6-9f13-a5702381f2b8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:00.702903 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fcde8-c4bb-42be-a196-84790b5da182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:00.704218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fcde8-c4bb-42be-a196-84790b5da182 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.704517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fcde8-c4bb-42be-a196-84790b5da182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.704791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1fcde8-c4bb-42be-a196-84790b5da182 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.705475 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fcde8-c4bb-42be-a196-84790b5da182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:00.707411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1fcde8-c4bb-42be-a196-84790b5da182 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:00.740609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1348/2673] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:00 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:00.741938 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cb277-d031-4085-8f78-63f5f60e341a admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:00.753961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8cb277-d031-4085-8f78-63f5f60e341a admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:00.826930 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1617c-c262-40bb-a15f-60a2b8f0c150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:00.827668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1617c-c262-40bb-a15f-60a2b8f0c150 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.827906 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1617c-c262-40bb-a15f-60a2b8f0c150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.828685 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1617c-c262-40bb-a15f-60a2b8f0c150 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.829385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1617c-c262-40bb-a15f-60a2b8f0c150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:00.831550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a1617c-c262-40bb-a15f-60a2b8f0c150 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:00.860786 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1326/2674] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:00 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:50:00.861367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fcde8-c4bb-42be-a196-84790b5da182 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:00.874278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1fcde8-c4bb-42be-a196-84790b5da182 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:00.881033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f8a7-e19c-4f4d-a456-5178807bd18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:00.882191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f8a7-e19c-4f4d-a456-5178807bd18a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.882725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f8a7-e19c-4f4d-a456-5178807bd18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.883383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b3f8a7-e19c-4f4d-a456-5178807bd18a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.884331 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3f8a7-e19c-4f4d-a456-5178807bd18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:00.887034 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b3f8a7-e19c-4f4d-a456-5178807bd18a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:00.900847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1349/2675] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:50:00.907190 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1617c-c262-40bb-a15f-60a2b8f0c150 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:00.920469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1617c-c262-40bb-a15f-60a2b8f0c150 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:00.926875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae711153-67f0-4f37-aa20-76791370a4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:00.927853 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae711153-67f0-4f37-aa20-76791370a4bd admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.928359 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae711153-67f0-4f37-aa20-76791370a4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.928897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae711153-67f0-4f37-aa20-76791370a4bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.929753 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae711153-67f0-4f37-aa20-76791370a4bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:00.931567 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae711153-67f0-4f37-aa20-76791370a4bd admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:00.948729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1327/2676] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:00.949887 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f8a7-e19c-4f4d-a456-5178807bd18a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:00.960536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b3f8a7-e19c-4f4d-a456-5178807bd18a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:00.965585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be8fb2-90f3-4a62-af91-40057e52eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:00.966528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8fb2-90f3-4a62-af91-40057e52eca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:00.966883 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8fb2-90f3-4a62-af91-40057e52eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:00.967160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be8fb2-90f3-4a62-af91-40057e52eca1 admin admin] PATH_INFO: `/v3/projects/8c22517f01b04b54a11824639d42d4e6/users/05e9cae3a05947e983a8774d98bd354d/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:00.986511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be8fb2-90f3-4a62-af91-40057e52eca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c22517f01b04b54a11824639d42d4e6, user_id=05e9cae3a05947e983a8774d98bd354d, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:00.989330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be8fb2-90f3-4a62-af91-40057e52eca1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:01.018112 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1350/2677] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:00 2022] PUT /identity/v3/projects/8c22517f01b04b54a11824639d42d4e6/users/05e9cae3a05947e983a8774d98bd354d/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:01.083354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67482b-bac7-415e-a18d-e20e9d1990e2 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:01.083845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67482b-bac7-415e-a18d-e20e9d1990e2 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:01.084144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc67482b-bac7-415e-a18d-e20e9d1990e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:01.090325 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:01.123134 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-cc67482b-bac7-415e-a18d-e20e9d1990e2 None None] MFA Rules not processed for user `05e9cae3a05947e983a8774d98bd354d`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:01.124396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-cc67482b-bac7-415e-a18d-e20e9d1990e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:01.226148 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1328/2678] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:01.228225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be8fb2-90f3-4a62-af91-40057e52eca1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:01.283715 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:01.301108 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be8fb2-90f3-4a62-af91-40057e52eca1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:01.306030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f4bba-34f3-4a17-ae17-8a3fa2b4d647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:01.306954 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4bba-34f3-4a17-ae17-8a3fa2b4d647 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:01.307192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4bba-34f3-4a17-ae17-8a3fa2b4d647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:01.307672 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34f4bba-34f3-4a17-ae17-8a3fa2b4d647 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:01.308228 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f4bba-34f3-4a17-ae17-8a3fa2b4d647 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:01.310690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34f4bba-34f3-4a17-ae17-8a3fa2b4d647 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:01.342925 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1351/2679] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:01 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:01.344451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67482b-bac7-415e-a18d-e20e9d1990e2 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:01.355991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc67482b-bac7-415e-a18d-e20e9d1990e2 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:01.431037 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c9606-d8df-4b86-8d20-b39c423b6f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:01.431671 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c9606-d8df-4b86-8d20-b39c423b6f04 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:01.431953 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c9606-d8df-4b86-8d20-b39c423b6f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:01.432232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c9606-d8df-4b86-8d20-b39c423b6f04 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:01.432939 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c9606-d8df-4b86-8d20-b39c423b6f04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:01.434985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c9606-d8df-4b86-8d20-b39c423b6f04 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:01.457941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1329/2680] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:01 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:01.462243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f4bba-34f3-4a17-ae17-8a3fa2b4d647 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:01.473571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34f4bba-34f3-4a17-ae17-8a3fa2b4d647 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:01.478521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538a2bc-5d90-4fcc-b22c-ac7957ed3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:01.479211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538a2bc-5d90-4fcc-b22c-ac7957ed3d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:01.479495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538a2bc-5d90-4fcc-b22c-ac7957ed3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:01.479774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538a2bc-5d90-4fcc-b22c-ac7957ed3d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:01.480509 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538a2bc-5d90-4fcc-b22c-ac7957ed3d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:01.482185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538a2bc-5d90-4fcc-b22c-ac7957ed3d34 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:01.494870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1352/2681] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:01.502690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c9606-d8df-4b86-8d20-b39c423b6f04 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:01.514186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c9606-d8df-4b86-8d20-b39c423b6f04 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:01.519653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2e48-3446-41cf-8560-d0cd0cfc10e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:01.520722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2e48-3446-41cf-8560-d0cd0cfc10e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:01.521006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2e48-3446-41cf-8560-d0cd0cfc10e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:01.521284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b2e48-3446-41cf-8560-d0cd0cfc10e5 admin admin] PATH_INFO: `/v3/projects/77d1b4a49c9f4240a127711eef93865c/users/f7d153d525fe4706988b983615e60c95/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:01.538606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b2e48-3446-41cf-8560-d0cd0cfc10e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d1b4a49c9f4240a127711eef93865c, user_id=f7d153d525fe4706988b983615e60c95, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:01.541312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b2e48-3446-41cf-8560-d0cd0cfc10e5 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:01.558455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1330/2682] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:01 2022] PUT /identity/v3/projects/77d1b4a49c9f4240a127711eef93865c/users/f7d153d525fe4706988b983615e60c95/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:01.563116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538a2bc-5d90-4fcc-b22c-ac7957ed3d34 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:01.573815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538a2bc-5d90-4fcc-b22c-ac7957ed3d34 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:01.634457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992193b-3a5a-464b-9ff8-c20d493c2da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:01.635155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992193b-3a5a-464b-9ff8-c20d493c2da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:01.635441 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992193b-3a5a-464b-9ff8-c20d493c2da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:01.635722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992193b-3a5a-464b-9ff8-c20d493c2da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:01.636449 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992193b-3a5a-464b-9ff8-c20d493c2da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:01.638105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992193b-3a5a-464b-9ff8-c20d493c2da7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:01.650138 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1353/2683] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:01.653657 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2e48-3446-41cf-8560-d0cd0cfc10e5 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:01.665474 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b2e48-3446-41cf-8560-d0cd0cfc10e5 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:01.671510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f39b9-d846-44fc-ab3b-004fc9264cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:01.672535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f39b9-d846-44fc-ab3b-004fc9264cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:01.673126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f39b9-d846-44fc-ab3b-004fc9264cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:01.673404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f39b9-d846-44fc-ab3b-004fc9264cc1 admin admin] PATH_INFO: `/v3/projects/77d1b4a49c9f4240a127711eef93865c/users/f7d153d525fe4706988b983615e60c95/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:01.675663 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f39b9-d846-44fc-ab3b-004fc9264cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d1b4a49c9f4240a127711eef93865c, user_id=f7d153d525fe4706988b983615e60c95, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:01.678531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f39b9-d846-44fc-ab3b-004fc9264cc1 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:01.690621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1331/2684] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:01 2022] PUT /identity/v3/projects/77d1b4a49c9f4240a127711eef93865c/users/f7d153d525fe4706988b983615e60c95/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:01.700464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a0da-8637-4eea-b832-2a0ab17cfcb9 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:01.700840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a0da-8637-4eea-b832-2a0ab17cfcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:01.701199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792a0da-8637-4eea-b832-2a0ab17cfcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:01.732370 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-7792a0da-8637-4eea-b832-2a0ab17cfcb9 None None] MFA Rules not processed for user `f7d153d525fe4706988b983615e60c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:01.733649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-7792a0da-8637-4eea-b832-2a0ab17cfcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:01.814528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1354/2685] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:01.826963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f39b9-d846-44fc-ab3b-004fc9264cc1 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:01.829377 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-329f39b9-d846-44fc-ab3b-004fc9264cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:01.878222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:01.891224 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f39b9-d846-44fc-ab3b-004fc9264cc1 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:01.894857 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048db981-d730-4bbd-88d2-8468800bcff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:01.895493 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048db981-d730-4bbd-88d2-8468800bcff0 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:01.895781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048db981-d730-4bbd-88d2-8468800bcff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:01.896055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048db981-d730-4bbd-88d2-8468800bcff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:01.905307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048db981-d730-4bbd-88d2-8468800bcff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:01.906849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048db981-d730-4bbd-88d2-8468800bcff0 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:01.916560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1332/2686] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:01.995030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a0da-8637-4eea-b832-2a0ab17cfcb9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:02.007568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792a0da-8637-4eea-b832-2a0ab17cfcb9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:02.011216 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40c0af-d63c-40ec-b30a-a7cfc38b1fca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:02.012374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c0af-d63c-40ec-b30a-a7cfc38b1fca service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:02.012995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c0af-d63c-40ec-b30a-a7cfc38b1fca service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:02.013604 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40c0af-d63c-40ec-b30a-a7cfc38b1fca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:02.111245 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:02.131074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c0af-d63c-40ec-b30a-a7cfc38b1fca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:02.132930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40c0af-d63c-40ec-b30a-a7cfc38b1fca service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:02.145854 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1355/2687] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:02.552105 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048db981-d730-4bbd-88d2-8468800bcff0 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:02.637767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048db981-d730-4bbd-88d2-8468800bcff0 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:02.643216 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:02.644300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:02.644662 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:02.644830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] PATH_INFO: `/v3/users/05e9cae3a05947e983a8774d98bd354d` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:02.646227 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=05e9cae3a05947e983a8774d98bd354d)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:02.648420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:02.700529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05e9cae3a05947e983a8774d98bd354d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:02.701089 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05e9cae3a05947e983a8774d98bd354d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:02.701734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05e9cae3a05947e983a8774d98bd354d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:02.718146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05e9cae3a05947e983a8774d98bd354d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:02.726072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05e9cae3a05947e983a8774d98bd354d'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:02.740711 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1333/2688] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:02 2022] DELETE /identity/v3/users/05e9cae3a05947e983a8774d98bd354d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:02.745697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a526b-093b-416b-9a4d-eb43fda7cbf9 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:02.746275 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a526b-093b-416b-9a4d-eb43fda7cbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:02.746392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658a526b-093b-416b-9a4d-eb43fda7cbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:02.765557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-658a526b-093b-416b-9a4d-eb43fda7cbf9 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:02.766882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-658a526b-093b-416b-9a4d-eb43fda7cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:02.847194 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1356/2689] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:02.857386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:02.859221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:02.932122 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8989ad-3d24-4853-8253-bff3838134cf admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:02.936438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e6826-ad21-4857-949d-0e23a5b6a6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:02.937131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e6826-ad21-4857-949d-0e23a5b6a6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:02.937446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e6826-ad21-4857-949d-0e23a5b6a6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:02.937723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e6826-ad21-4857-949d-0e23a5b6a6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:02.948394 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e6826-ad21-4857-949d-0e23a5b6a6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:02.949876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e6826-ad21-4857-949d-0e23a5b6a6c2 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:02.970375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1334/2690] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:03.280806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a526b-093b-416b-9a4d-eb43fda7cbf9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:03.283254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-658a526b-093b-416b-9a4d-eb43fda7cbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:03.302210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658a526b-093b-416b-9a4d-eb43fda7cbf9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:03.307659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:03.308585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:03.309103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:03.309384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] PATH_INFO: `/v3/projects/8c22517f01b04b54a11824639d42d4e6` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:03.310710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c22517f01b04b54a11824639d42d4e6)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:03.313506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:03.384162 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c22517f01b04b54a11824639d42d4e6', 'request_id': 'req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:03.393424 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c22517f01b04b54a11824639d42d4e6', 'request_id': 'req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:03.405357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c22517f01b04b54a11824639d42d4e6', 'request_id': 'req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:03.421536 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] The token cache is being invalidate because project 8c22517f01b04b54a11824639d42d4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:03.421827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:03.423124 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:03.424945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1357/2691] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:03 2022] DELETE /identity/v3/projects/8c22517f01b04b54a11824639d42d4e6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:03.430009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e6826-ad21-4857-949d-0e23a5b6a6c2 service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:03.440654 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e6826-ad21-4857-949d-0e23a5b6a6c2 service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:03.446456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:03.512904 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:03.513816 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:03.514120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:03.514390 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] PATH_INFO: `/v3/users/f7d153d525fe4706988b983615e60c95` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:03.516495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7d153d525fe4706988b983615e60c95)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:03.518462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:03.580533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7d153d525fe4706988b983615e60c95'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:03.581193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7d153d525fe4706988b983615e60c95'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:03.582144 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7d153d525fe4706988b983615e60c95'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:03.599392 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7d153d525fe4706988b983615e60c95'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:03.610270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c3bab52f-6640-4c42-9720-8a50ccab51de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7d153d525fe4706988b983615e60c95'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:03.626546 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1335/2692] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:03 2022] DELETE /identity/v3/users/f7d153d525fe4706988b983615e60c95 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:03.960141 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:03.961606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:03.976991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d8e8ad-43bc-4adf-8e23-7a05aba2207f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:04.050510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:04.051997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.052492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.052984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] PATH_INFO: `/v3/projects/77d1b4a49c9f4240a127711eef93865c` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.055082 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d1b4a49c9f4240a127711eef93865c)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:04.059041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:04.066761 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:04.113955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d1b4a49c9f4240a127711eef93865c', 'request_id': 'req-1465842e-d99f-41f2-8a12-6df3a8e297be'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:04.121603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d1b4a49c9f4240a127711eef93865c', 'request_id': 'req-1465842e-d99f-41f2-8a12-6df3a8e297be'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:04.128413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d1b4a49c9f4240a127711eef93865c', 'request_id': 'req-1465842e-d99f-41f2-8a12-6df3a8e297be'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:04.139539 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] The token cache is being invalidate because project 77d1b4a49c9f4240a127711eef93865c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:04.139827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:04.140590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-1465842e-d99f-41f2-8a12-6df3a8e297be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:04.142284 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1358/2693] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:03 2022] DELETE /identity/v3/projects/77d1b4a49c9f4240a127711eef93865c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:04.147414 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa33a-f59a-4cad-808d-66c35c7a3cd8 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.147912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa33a-f59a-4cad-808d-66c35c7a3cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.148067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0fa33a-f59a-4cad-808d-66c35c7a3cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.166338 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-ba0fa33a-f59a-4cad-808d-66c35c7a3cd8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:04.167564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ba0fa33a-f59a-4cad-808d-66c35c7a3cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:04.229073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1336/2694] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:04.238816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba118d7-388f-41cd-848b-e49b75dcc3be None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.239105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba118d7-388f-41cd-848b-e49b75dcc3be None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.239386 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba118d7-388f-41cd-848b-e49b75dcc3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.258546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-4ba118d7-388f-41cd-848b-e49b75dcc3be None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:04.259664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4ba118d7-388f-41cd-848b-e49b75dcc3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:04.267670 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1359/2695] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:04.272075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fa33a-f59a-4cad-808d-66c35c7a3cd8 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:04.282842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0fa33a-f59a-4cad-808d-66c35c7a3cd8 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:04.287730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc172c-bc2c-4363-9120-051410ef698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:04.288438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc172c-bc2c-4363-9120-051410ef698c admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.288724 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc172c-bc2c-4363-9120-051410ef698c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.289011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffc172c-bc2c-4363-9120-051410ef698c admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.289751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc172c-bc2c-4363-9120-051410ef698c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:50:04.290061 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc172c-bc2c-4363-9120-051410ef698c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:04.291789 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffc172c-bc2c-4363-9120-051410ef698c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:04.308218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1337/2696] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:50:04.312480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba118d7-388f-41cd-848b-e49b75dcc3be None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:04.322018 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba118d7-388f-41cd-848b-e49b75dcc3be None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:04.327151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe0917-a7b1-4e39-98f5-4bc13f92e9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:04.327872 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe0917-a7b1-4e39-98f5-4bc13f92e9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.328155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe0917-a7b1-4e39-98f5-4bc13f92e9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.328446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fe0917-a7b1-4e39-98f5-4bc13f92e9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.329227 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe0917-a7b1-4e39-98f5-4bc13f92e9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:04.331278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fe0917-a7b1-4e39-98f5-4bc13f92e9f1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:04.357425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1360/2697] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:04 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:04.362637 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc172c-bc2c-4363-9120-051410ef698c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:04.372984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffc172c-bc2c-4363-9120-051410ef698c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:04.386108 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:04.435283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2831-0ab5-4d7e-8ad9-9179f8b7959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:04.435960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2831-0ab5-4d7e-8ad9-9179f8b7959c admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.436246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2831-0ab5-4d7e-8ad9-9179f8b7959c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.436527 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa2831-0ab5-4d7e-8ad9-9179f8b7959c admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.437223 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa2831-0ab5-4d7e-8ad9-9179f8b7959c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:04.439204 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa2831-0ab5-4d7e-8ad9-9179f8b7959c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:04.459725 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1338/2698] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:04 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:50:04.463989 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe0917-a7b1-4e39-98f5-4bc13f92e9f1 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:04.475120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fe0917-a7b1-4e39-98f5-4bc13f92e9f1 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:04.479754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de84883-8153-4be6-88e9-412788023b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:04.480408 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de84883-8153-4be6-88e9-412788023b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.480688 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de84883-8153-4be6-88e9-412788023b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.480959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de84883-8153-4be6-88e9-412788023b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.481701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de84883-8153-4be6-88e9-412788023b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:04.483319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de84883-8153-4be6-88e9-412788023b00 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:04.494430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1361/2699] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:04.498397 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2831-0ab5-4d7e-8ad9-9179f8b7959c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:04.508741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa2831-0ab5-4d7e-8ad9-9179f8b7959c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:04.513257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab633ba-bc6a-4723-b151-fd363cce5a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:04.513913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab633ba-bc6a-4723-b151-fd363cce5a47 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.514233 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab633ba-bc6a-4723-b151-fd363cce5a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.514513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab633ba-bc6a-4723-b151-fd363cce5a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.515830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab633ba-bc6a-4723-b151-fd363cce5a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:04.517422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab633ba-bc6a-4723-b151-fd363cce5a47 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:04.527599 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1339/2700] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:04.532421 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de84883-8153-4be6-88e9-412788023b00 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:04.542466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de84883-8153-4be6-88e9-412788023b00 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:04.547091 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9fcba-c1a2-4553-9f4f-6880a046631f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:04.547967 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9fcba-c1a2-4553-9f4f-6880a046631f admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.548254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9fcba-c1a2-4553-9f4f-6880a046631f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.548533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f9fcba-c1a2-4553-9f4f-6880a046631f admin admin] PATH_INFO: `/v3/projects/4cd2f43c4c044ef5b129a7f5c405c367/users/673e42b791cc4eb0864a3ff0e7e9de54/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.565812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9fcba-c1a2-4553-9f4f-6880a046631f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd2f43c4c044ef5b129a7f5c405c367, user_id=673e42b791cc4eb0864a3ff0e7e9de54, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:04.568651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f9fcba-c1a2-4553-9f4f-6880a046631f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:04.584363 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1362/2701] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:04 2022] PUT /identity/v3/projects/4cd2f43c4c044ef5b129a7f5c405c367/users/673e42b791cc4eb0864a3ff0e7e9de54/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:04.595247 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7efd6-83fe-4fef-9323-15e0319fcda5 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.595540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7efd6-83fe-4fef-9323-15e0319fcda5 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.595824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7efd6-83fe-4fef-9323-15e0319fcda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.622928 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-26b7efd6-83fe-4fef-9323-15e0319fcda5 None None] MFA Rules not processed for user `673e42b791cc4eb0864a3ff0e7e9de54`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:04.624176 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-26b7efd6-83fe-4fef-9323-15e0319fcda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:04.701622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1340/2702] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:04.710286 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9fcba-c1a2-4553-9f4f-6880a046631f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:04.712005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-96f9fcba-c1a2-4553-9f4f-6880a046631f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:04.778036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f9fcba-c1a2-4553-9f4f-6880a046631f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:04.782361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01849853-f03f-4ffc-81bd-0ee1f8f266ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0edbf66359f1426999f4c28a83f2bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:04.783011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01849853-f03f-4ffc-81bd-0ee1f8f266ca service glance] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:04.783293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01849853-f03f-4ffc-81bd-0ee1f8f266ca service glance] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:04.783569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01849853-f03f-4ffc-81bd-0ee1f8f266ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:04.792549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01849853-f03f-4ffc-81bd-0ee1f8f266ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:04.793990 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01849853-f03f-4ffc-81bd-0ee1f8f266ca service glance] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:04.804084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1363/2703] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:04 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:05.998065 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7efd6-83fe-4fef-9323-15e0319fcda5 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:06.006445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-26b7efd6-83fe-4fef-9323-15e0319fcda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:06.065977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7efd6-83fe-4fef-9323-15e0319fcda5 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:06.069631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5bdf4-d89d-40b9-85cd-2dbad6a381cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:06.070307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5bdf4-d89d-40b9-85cd-2dbad6a381cc service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:06.070586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5bdf4-d89d-40b9-85cd-2dbad6a381cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:06.070858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5bdf4-d89d-40b9-85cd-2dbad6a381cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:06.072624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f8e5bdf4-d89d-40b9-85cd-2dbad6a381cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:06.117456 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:06.150300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5bdf4-d89d-40b9-85cd-2dbad6a381cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:06.151766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5bdf4-d89d-40b9-85cd-2dbad6a381cc service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:06.173680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1341/2704] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:07.540607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01849853-f03f-4ffc-81bd-0ee1f8f266ca service glance] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:07.542031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-01849853-f03f-4ffc-81bd-0ee1f8f266ca service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:07.555649 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01849853-f03f-4ffc-81bd-0ee1f8f266ca service glance] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:07.560102 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:07.560961 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:07.561241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:07.561514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] PATH_INFO: `/v3/users/459ebbe3a8214441b13bea68e445f4e8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:07.562721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] RBAC: Authorizing `identity:delete_user(user_id=459ebbe3a8214441b13bea68e445f4e8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:07.564622 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:07.596889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:07.622548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '459ebbe3a8214441b13bea68e445f4e8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:07.631527 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '459ebbe3a8214441b13bea68e445f4e8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:07.632244 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '459ebbe3a8214441b13bea68e445f4e8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:07.650507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '459ebbe3a8214441b13bea68e445f4e8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:07.658746 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '459ebbe3a8214441b13bea68e445f4e8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:07.668768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1364/2705] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:07 2022] DELETE /identity/v3/users/459ebbe3a8214441b13bea68e445f4e8 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:07.670750 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bc951-ca8a-416b-baeb-181fc186cf8e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:07.671692 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bc951-ca8a-416b-baeb-181fc186cf8e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:07.672246 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27bc951-ca8a-416b-baeb-181fc186cf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:07.699208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e27bc951-ca8a-416b-baeb-181fc186cf8e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:07.701443 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e27bc951-ca8a-416b-baeb-181fc186cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:07.803113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1342/2706] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:07.814694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:07.816329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:07.917859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153c771-d7a0-4da3-b71b-668689d96721 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:07.924731 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0383b2-e855-4fe7-a455-4e58836b0d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:07.925453 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0383b2-e855-4fe7-a455-4e58836b0d2d service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:07.925677 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0383b2-e855-4fe7-a455-4e58836b0d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:07.925955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0383b2-e855-4fe7-a455-4e58836b0d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:07.946838 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0383b2-e855-4fe7-a455-4e58836b0d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:07.948336 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0383b2-e855-4fe7-a455-4e58836b0d2d service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:07.966834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1365/2707] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:08.588937 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bc951-ca8a-416b-baeb-181fc186cf8e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:08.595510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e27bc951-ca8a-416b-baeb-181fc186cf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:08.608541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27bc951-ca8a-416b-baeb-181fc186cf8e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:08.620287 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:08.621710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:08.622369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:08.622946 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] PATH_INFO: `/v3/projects/e3ba8a4f283e4c00a06d03a03d61a99e` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:08.625486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ba8a4f283e4c00a06d03a03d61a99e)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:08.629559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:08.713383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ba8a4f283e4c00a06d03a03d61a99e', 'request_id': 'req-e4d5706c-ee58-463a-a909-6b3996908804'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:08.726421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ba8a4f283e4c00a06d03a03d61a99e', 'request_id': 'req-e4d5706c-ee58-463a-a909-6b3996908804'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:08.740464 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ba8a4f283e4c00a06d03a03d61a99e', 'request_id': 'req-e4d5706c-ee58-463a-a909-6b3996908804'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:08.752555 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] The token cache is being invalidate because project e3ba8a4f283e4c00a06d03a03d61a99e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:08.752845 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:08.754183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-e4d5706c-ee58-463a-a909-6b3996908804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:08.756019 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1343/2708] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:08 2022] DELETE /identity/v3/projects/e3ba8a4f283e4c00a06d03a03d61a99e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:08.761058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e80a37-c169-43e4-ad11-9c342315e96b None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:08.761643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e80a37-c169-43e4-ad11-9c342315e96b None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:08.761643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e80a37-c169-43e4-ad11-9c342315e96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:08.784768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c0e80a37-c169-43e4-ad11-9c342315e96b None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:08.786051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c0e80a37-c169-43e4-ad11-9c342315e96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:08.866004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1366/2709] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:08.874100 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dd428-1bcc-4b32-ad5e-88e5e89b4694 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:08.874661 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dd428-1bcc-4b32-ad5e-88e5e89b4694 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:08.879380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1dd428-1bcc-4b32-ad5e-88e5e89b4694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:08.899229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7e1dd428-1bcc-4b32-ad5e-88e5e89b4694 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:08.900893 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7e1dd428-1bcc-4b32-ad5e-88e5e89b4694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:08.912123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1344/2710] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:08.916946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e80a37-c169-43e4-ad11-9c342315e96b None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:08.928096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e80a37-c169-43e4-ad11-9c342315e96b None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:08.934006 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f6d51-8419-460d-b0f4-50228a3f589a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:08.934808 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f6d51-8419-460d-b0f4-50228a3f589a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:08.935161 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f6d51-8419-460d-b0f4-50228a3f589a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:08.935511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f6d51-8419-460d-b0f4-50228a3f589a admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:08.936330 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f6d51-8419-460d-b0f4-50228a3f589a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:50:08.936647 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f6d51-8419-460d-b0f4-50228a3f589a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:08.938346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f6d51-8419-460d-b0f4-50228a3f589a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:08.954725 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1367/2711] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:50:08.956254 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dd428-1bcc-4b32-ad5e-88e5e89b4694 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:08.966703 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1dd428-1bcc-4b32-ad5e-88e5e89b4694 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:08.977045 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a0c0f-9a59-47f7-98fe-ade316d7bfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:08.977814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a0c0f-9a59-47f7-98fe-ade316d7bfb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:08.978220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a0c0f-9a59-47f7-98fe-ade316d7bfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:08.978563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a0c0f-9a59-47f7-98fe-ade316d7bfb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:08.979485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a0c0f-9a59-47f7-98fe-ade316d7bfb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:08.981872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9a0c0f-9a59-47f7-98fe-ade316d7bfb1 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.013044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1345/2712] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:08 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:50:09.014241 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f6d51-8419-460d-b0f4-50228a3f589a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.036653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f6d51-8419-460d-b0f4-50228a3f589a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.101254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:09.144464 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ec5a8-8b97-408c-9a54-cb14ea34f65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.145159 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ec5a8-8b97-408c-9a54-cb14ea34f65d admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.145500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ec5a8-8b97-408c-9a54-cb14ea34f65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.145710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ec5a8-8b97-408c-9a54-cb14ea34f65d admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.146546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ec5a8-8b97-408c-9a54-cb14ea34f65d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.148569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368ec5a8-8b97-408c-9a54-cb14ea34f65d admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.177355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1368/2713] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:09 2022] POST /identity/v3/users => generated 292 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:09.182069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a0c0f-9a59-47f7-98fe-ade316d7bfb1 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.196956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a0c0f-9a59-47f7-98fe-ade316d7bfb1 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.203434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166b5f8-adcf-43e0-a893-fe69c6451813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.204138 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166b5f8-adcf-43e0-a893-fe69c6451813 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.204424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166b5f8-adcf-43e0-a893-fe69c6451813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.204924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166b5f8-adcf-43e0-a893-fe69c6451813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.205611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166b5f8-adcf-43e0-a893-fe69c6451813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.207304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166b5f8-adcf-43e0-a893-fe69c6451813 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.224907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1346/2714] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:09.233650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ec5a8-8b97-408c-9a54-cb14ea34f65d admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.253185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ec5a8-8b97-408c-9a54-cb14ea34f65d admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.266944 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356ecca-8f6c-4ab3-849b-24710fe2ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.268222 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ecca-8f6c-4ab3-849b-24710fe2ade0 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.268507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ecca-8f6c-4ab3-849b-24710fe2ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.268846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356ecca-8f6c-4ab3-849b-24710fe2ade0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.270266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356ecca-8f6c-4ab3-849b-24710fe2ade0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.272376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356ecca-8f6c-4ab3-849b-24710fe2ade0 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.289942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1369/2715] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:09.293970 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166b5f8-adcf-43e0-a893-fe69c6451813 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.306451 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166b5f8-adcf-43e0-a893-fe69c6451813 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.313424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c75fe5-42c3-48be-a287-e164f22adc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.314467 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c75fe5-42c3-48be-a287-e164f22adc90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.314827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c75fe5-42c3-48be-a287-e164f22adc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.315185 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c75fe5-42c3-48be-a287-e164f22adc90 admin admin] PATH_INFO: `/v3/projects/a5c34ce4fb4f441fa66cbec3452de114/users/b26d3df5bdba4fa0a67f9c161cee70ad/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.332632 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c75fe5-42c3-48be-a287-e164f22adc90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5c34ce4fb4f441fa66cbec3452de114, user_id=b26d3df5bdba4fa0a67f9c161cee70ad, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.335515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c75fe5-42c3-48be-a287-e164f22adc90 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.338621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:09.359612 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1347/2716] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:09 2022] PUT /identity/v3/projects/a5c34ce4fb4f441fa66cbec3452de114/users/b26d3df5bdba4fa0a67f9c161cee70ad/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:09.372043 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69d30-849a-423a-866b-e99e167d3cfd None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.372733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69d30-849a-423a-866b-e99e167d3cfd None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.373239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d69d30-849a-423a-866b-e99e167d3cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.412862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e0d69d30-849a-423a-866b-e99e167d3cfd None None] MFA Rules not processed for user `b26d3df5bdba4fa0a67f9c161cee70ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:09.415418 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e0d69d30-849a-423a-866b-e99e167d3cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:09.549210 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1370/2717] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:09.559431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c75fe5-42c3-48be-a287-e164f22adc90 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.687837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c75fe5-42c3-48be-a287-e164f22adc90 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.695209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6f89-10d4-45be-8c63-a5b5312c28ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.696066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6f89-10d4-45be-8c63-a5b5312c28ce admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.696416 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6f89-10d4-45be-8c63-a5b5312c28ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.696764 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed6f89-10d4-45be-8c63-a5b5312c28ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.697548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6f89-10d4-45be-8c63-a5b5312c28ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.699807 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed6f89-10d4-45be-8c63-a5b5312c28ce admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.742639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1348/2718] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:09 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:09.744596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d69d30-849a-423a-866b-e99e167d3cfd None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.756349 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d69d30-849a-423a-866b-e99e167d3cfd None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.783286 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6f89-10d4-45be-8c63-a5b5312c28ce admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.785345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-09ed6f89-10d4-45be-8c63-a5b5312c28ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:09.834694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662d6a-cf68-42ab-bfb0-00d5eff38a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.835381 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662d6a-cf68-42ab-bfb0-00d5eff38a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.835665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662d6a-cf68-42ab-bfb0-00d5eff38a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.835941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662d6a-cf68-42ab-bfb0-00d5eff38a0e admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.836633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83662d6a-cf68-42ab-bfb0-00d5eff38a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.838631 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83662d6a-cf68-42ab-bfb0-00d5eff38a0e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.861077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1371/2719] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:09 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:09.865010 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662d6a-cf68-42ab-bfb0-00d5eff38a0e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.868554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed6f89-10d4-45be-8c63-a5b5312c28ce admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.874445 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.875571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.875909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.876191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662d6a-cf68-42ab-bfb0-00d5eff38a0e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.876316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] PATH_INFO: `/v3/users/43fc4ad124f943c086954c28a0a6e199` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.877722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] RBAC: Authorizing `identity:delete_user(user_id=43fc4ad124f943c086954c28a0a6e199)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.879920 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.881739 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6aea5-6161-401d-9567-9a5ad59d5f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.882512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6aea5-6161-401d-9567-9a5ad59d5f33 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.882813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6aea5-6161-401d-9567-9a5ad59d5f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.883097 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6aea5-6161-401d-9567-9a5ad59d5f33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.883889 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6aea5-6161-401d-9567-9a5ad59d5f33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.885537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6aea5-6161-401d-9567-9a5ad59d5f33 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.898173 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1372/2720] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:50:09.902218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6aea5-6161-401d-9567-9a5ad59d5f33 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.918837 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6aea5-6161-401d-9567-9a5ad59d5f33 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.924834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfa11d-2105-4fa0-b358-8f9c1c5877cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.925487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa11d-2105-4fa0-b358-8f9c1c5877cf admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.925768 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa11d-2105-4fa0-b358-8f9c1c5877cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.926040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbfa11d-2105-4fa0-b358-8f9c1c5877cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.926795 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfa11d-2105-4fa0-b358-8f9c1c5877cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.928403 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbfa11d-2105-4fa0-b358-8f9c1c5877cf admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:09.932770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43fc4ad124f943c086954c28a0a6e199'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:09.933531 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43fc4ad124f943c086954c28a0a6e199'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:09.934265 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43fc4ad124f943c086954c28a0a6e199'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:09.941354 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1373/2721] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:50:09.946107 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfa11d-2105-4fa0-b358-8f9c1c5877cf admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:09.948208 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43fc4ad124f943c086954c28a0a6e199'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:09.948561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bbbfa11d-2105-4fa0-b358-8f9c1c5877cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:09.956181 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f8e37d9f-1cc1-488f-bea6-70905818718e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43fc4ad124f943c086954c28a0a6e199'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:09.962436 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbfa11d-2105-4fa0-b358-8f9c1c5877cf admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:09.965915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:09.967656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc04960-16c5-4c37-b099-4af76aa0971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:09.969219 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc04960-16c5-4c37-b099-4af76aa0971f admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:09.969512 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc04960-16c5-4c37-b099-4af76aa0971f admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:09.969791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc04960-16c5-4c37-b099-4af76aa0971f admin admin] PATH_INFO: `/v3/projects/ed251aa699e94292b4c10f1b1585ef17/users/51493d6d66d84219a9a46a427f7cd5d4/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:09.973080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1349/2722] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:09 2022] DELETE /identity/v3/users/43fc4ad124f943c086954c28a0a6e199 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:09.980155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:09.989297 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc04960-16c5-4c37-b099-4af76aa0971f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed251aa699e94292b4c10f1b1585ef17, user_id=51493d6d66d84219a9a46a427f7cd5d4, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:09.992045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc04960-16c5-4c37-b099-4af76aa0971f admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.011811 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1374/2723] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:09 2022] PUT /identity/v3/projects/ed251aa699e94292b4c10f1b1585ef17/users/51493d6d66d84219a9a46a427f7cd5d4/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:10.029155 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc56251-ff32-4bb9-8470-111dbffa521e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.029644 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc56251-ff32-4bb9-8470-111dbffa521e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.030289 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc56251-ff32-4bb9-8470-111dbffa521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.071660 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7fc56251-ff32-4bb9-8470-111dbffa521e None None] MFA Rules not processed for user `51493d6d66d84219a9a46a427f7cd5d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:10.072917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7fc56251-ff32-4bb9-8470-111dbffa521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:10.145880 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1350/2724] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:10.150607 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc04960-16c5-4c37-b099-4af76aa0971f admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.176580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc56251-ff32-4bb9-8470-111dbffa521e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.178177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7fc56251-ff32-4bb9-8470-111dbffa521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:10.249941 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc04960-16c5-4c37-b099-4af76aa0971f admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.255815 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728f264-bfed-478e-b408-315b22117cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.256513 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728f264-bfed-478e-b408-315b22117cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.256850 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728f264-bfed-478e-b408-315b22117cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.257134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728f264-bfed-478e-b408-315b22117cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.257858 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728f264-bfed-478e-b408-315b22117cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.260042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728f264-bfed-478e-b408-315b22117cf8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.274622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc56251-ff32-4bb9-8470-111dbffa521e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.280074 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.281026 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.281298 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.281568 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] PATH_INFO: `/v3/projects/32777bb10850414495c96c6619cfd85a` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.282798 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32777bb10850414495c96c6619cfd85a)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.284709 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.293650 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1375/2725] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:10 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:10.298594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728f264-bfed-478e-b408-315b22117cf8 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.336380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32777bb10850414495c96c6619cfd85a', 'request_id': 'req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:10.344902 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32777bb10850414495c96c6619cfd85a', 'request_id': 'req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:10.351391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32777bb10850414495c96c6619cfd85a', 'request_id': 'req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:10.364485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] The token cache is being invalidate because project 32777bb10850414495c96c6619cfd85a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:10.364780 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:10.365602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-addebe9d-bafb-4dfd-a2bd-18b7b17f95c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:10.367219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1351/2726] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:10 2022] DELETE /identity/v3/projects/32777bb10850414495c96c6619cfd85a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:10.378617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfe3a4-3ef8-4fd7-9efc-2945942b2a56 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.378617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfe3a4-3ef8-4fd7-9efc-2945942b2a56 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.378617 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfe3a4-3ef8-4fd7-9efc-2945942b2a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.395422 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-63cfe3a4-3ef8-4fd7-9efc-2945942b2a56 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:10.395668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728f264-bfed-478e-b408-315b22117cf8 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.395793 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-63cfe3a4-3ef8-4fd7-9efc-2945942b2a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:10.408855 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:10.463052 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577c872-0a2d-4ce5-8351-0e4f74694a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.464114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577c872-0a2d-4ce5-8351-0e4f74694a98 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.464577 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577c872-0a2d-4ce5-8351-0e4f74694a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.464833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577c872-0a2d-4ce5-8351-0e4f74694a98 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.465619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577c872-0a2d-4ce5-8351-0e4f74694a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.467391 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1352/2727] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:10.467729 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2577c872-0a2d-4ce5-8351-0e4f74694a98 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.475010 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e804a52-a0f6-4e69-805f-d488d0b53d31 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.475301 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e804a52-a0f6-4e69-805f-d488d0b53d31 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.475988 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e804a52-a0f6-4e69-805f-d488d0b53d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.491859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1376/2728] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:10 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:10.493548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577c872-0a2d-4ce5-8351-0e4f74694a98 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.499383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7e804a52-a0f6-4e69-805f-d488d0b53d31 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:10.500234 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-2577c872-0a2d-4ce5-8351-0e4f74694a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:10.501288 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7e804a52-a0f6-4e69-805f-d488d0b53d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:10.509624 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1353/2729] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:10.512595 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577c872-0a2d-4ce5-8351-0e4f74694a98 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.514106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e804a52-a0f6-4e69-805f-d488d0b53d31 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.517957 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002708-9ff4-4416-845a-19c2fab824cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.518645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002708-9ff4-4416-845a-19c2fab824cf admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.518958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002708-9ff4-4416-845a-19c2fab824cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.519208 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7002708-9ff4-4416-845a-19c2fab824cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.519923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7002708-9ff4-4416-845a-19c2fab824cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.521516 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7002708-9ff4-4416-845a-19c2fab824cf admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.524080 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e804a52-a0f6-4e69-805f-d488d0b53d31 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.524294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:10.529072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a3b0b-8868-4387-9ebf-9826404b51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.529728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a3b0b-8868-4387-9ebf-9826404b51b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.530130 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a3b0b-8868-4387-9ebf-9826404b51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.530406 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a3b0b-8868-4387-9ebf-9826404b51b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.531587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a3b0b-8868-4387-9ebf-9826404b51b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:50:10.531932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a3b0b-8868-4387-9ebf-9826404b51b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.533869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882a3b0b-8868-4387-9ebf-9826404b51b9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.541074 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1377/2730] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:50:10.542058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002708-9ff4-4416-845a-19c2fab824cf admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.553560 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1354/2731] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:50:10.558176 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a3b0b-8868-4387-9ebf-9826404b51b9 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.558329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7002708-9ff4-4416-845a-19c2fab824cf admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.564461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dce95-af05-48bf-b5d4-2e79232c3629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.565846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dce95-af05-48bf-b5d4-2e79232c3629 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.566309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dce95-af05-48bf-b5d4-2e79232c3629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.566687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dce95-af05-48bf-b5d4-2e79232c3629 admin admin] PATH_INFO: `/v3/projects/f617e90bb8434bdfad1dc226b76f8cb7/users/c27ac2f4efa44a95840d315f34fedbe4/roles/308d9785120a49079e02659953a2b033` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.570708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a3b0b-8868-4387-9ebf-9826404b51b9 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.575680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9c94b-6684-426f-aaaa-4cbc64aeecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.576787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c94b-6684-426f-aaaa-4cbc64aeecd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.576787 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c94b-6684-426f-aaaa-4cbc64aeecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.577160 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9c94b-6684-426f-aaaa-4cbc64aeecd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.578146 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9c94b-6684-426f-aaaa-4cbc64aeecd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.580193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9c94b-6684-426f-aaaa-4cbc64aeecd2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.583790 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dce95-af05-48bf-b5d4-2e79232c3629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f617e90bb8434bdfad1dc226b76f8cb7, user_id=c27ac2f4efa44a95840d315f34fedbe4, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.586853 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dce95-af05-48bf-b5d4-2e79232c3629 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.614134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1378/2732] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:10 2022] PUT /identity/v3/projects/f617e90bb8434bdfad1dc226b76f8cb7/users/c27ac2f4efa44a95840d315f34fedbe4/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:10.618117 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1355/2733] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:10 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:50:10.618564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dce95-af05-48bf-b5d4-2e79232c3629 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.621253 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9c94b-6684-426f-aaaa-4cbc64aeecd2 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.693721 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dce95-af05-48bf-b5d4-2e79232c3629 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.694890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9c94b-6684-426f-aaaa-4cbc64aeecd2 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.699711 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ea6aa-9217-4890-a134-38d339d99465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.700583 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ea6aa-9217-4890-a134-38d339d99465 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.700869 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ea6aa-9217-4890-a134-38d339d99465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.701147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62ea6aa-9217-4890-a134-38d339d99465 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.702636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ea6aa-9217-4890-a134-38d339d99465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.702886 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8ae9d-2c85-42ae-992c-ed8e062127fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.704058 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8ae9d-2c85-42ae-992c-ed8e062127fe admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.704591 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62ea6aa-9217-4890-a134-38d339d99465 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.704705 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8ae9d-2c85-42ae-992c-ed8e062127fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.705204 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8ae9d-2c85-42ae-992c-ed8e062127fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.706878 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8ae9d-2c85-42ae-992c-ed8e062127fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.710249 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8ae9d-2c85-42ae-992c-ed8e062127fe admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.727340 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1379/2734] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:50:10.727622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1356/2735] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:10 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:50:10.733630 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ea6aa-9217-4890-a134-38d339d99465 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.737433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8ae9d-2c85-42ae-992c-ed8e062127fe admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.748307 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62ea6aa-9217-4890-a134-38d339d99465 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.751757 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8ae9d-2c85-42ae-992c-ed8e062127fe admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.754321 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d77244-ef6d-4ac8-8cd5-a4b96a047e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.755829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d77244-ef6d-4ac8-8cd5-a4b96a047e1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.756106 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d77244-ef6d-4ac8-8cd5-a4b96a047e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.756477 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d77244-ef6d-4ac8-8cd5-a4b96a047e1a admin admin] PATH_INFO: `/v3/projects/f617e90bb8434bdfad1dc226b76f8cb7/users/c27ac2f4efa44a95840d315f34fedbe4/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.758373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c99e5-ba4b-4e09-beaa-5caf0f82507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.759156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c99e5-ba4b-4e09-beaa-5caf0f82507c admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.759495 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c99e5-ba4b-4e09-beaa-5caf0f82507c admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.759834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1c99e5-ba4b-4e09-beaa-5caf0f82507c admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.760668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c99e5-ba4b-4e09-beaa-5caf0f82507c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.761772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d77244-ef6d-4ac8-8cd5-a4b96a047e1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f617e90bb8434bdfad1dc226b76f8cb7, user_id=c27ac2f4efa44a95840d315f34fedbe4, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.762384 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1c99e5-ba4b-4e09-beaa-5caf0f82507c admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.764495 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d77244-ef6d-4ac8-8cd5-a4b96a047e1a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.777499 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1380/2736] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:10.779000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c99e5-ba4b-4e09-beaa-5caf0f82507c admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.782217 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1357/2737] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:10 2022] PUT /identity/v3/projects/f617e90bb8434bdfad1dc226b76f8cb7/users/c27ac2f4efa44a95840d315f34fedbe4/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:10.789185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1c99e5-ba4b-4e09-beaa-5caf0f82507c admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.792651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e628c-287c-49a1-b9c9-47610879f0d9 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.792943 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e628c-287c-49a1-b9c9-47610879f0d9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.793226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e628c-287c-49a1-b9c9-47610879f0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.834774 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-452e628c-287c-49a1-b9c9-47610879f0d9 None None] MFA Rules not processed for user `c27ac2f4efa44a95840d315f34fedbe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:10.836183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-452e628c-287c-49a1-b9c9-47610879f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:10.855013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7350f-8198-4811-bda9-04270134a46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.856067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7350f-8198-4811-bda9-04270134a46e admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.856067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7350f-8198-4811-bda9-04270134a46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.856324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7350f-8198-4811-bda9-04270134a46e admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.857056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7350f-8198-4811-bda9-04270134a46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.858809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7350f-8198-4811-bda9-04270134a46e admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.874550 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1381/2738] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:10.876015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7350f-8198-4811-bda9-04270134a46e admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.886381 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7350f-8198-4811-bda9-04270134a46e admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:10.890161 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:10.891214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82baca-8845-47b3-9e9e-bd0d8059e7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:10.892272 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82baca-8845-47b3-9e9e-bd0d8059e7db admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.892629 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82baca-8845-47b3-9e9e-bd0d8059e7db admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.893062 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82baca-8845-47b3-9e9e-bd0d8059e7db admin admin] PATH_INFO: `/v3/projects/59281850bc694d7eb664baa0353286d9/users/2c821c2a732e4f8996382293cc97032d/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.910847 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82baca-8845-47b3-9e9e-bd0d8059e7db admin admin] RBAC: Authorizing `identity:create_grant(project_id=59281850bc694d7eb664baa0353286d9, user_id=2c821c2a732e4f8996382293cc97032d, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:10.913529 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82baca-8845-47b3-9e9e-bd0d8059e7db admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:10.922778 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1358/2739] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:10.940824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e628c-287c-49a1-b9c9-47610879f0d9 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:10.941465 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1382/2740] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:10 2022] PUT /identity/v3/projects/59281850bc694d7eb664baa0353286d9/users/2c821c2a732e4f8996382293cc97032d/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:10.943769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-452e628c-287c-49a1-b9c9-47610879f0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:10.952244 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb4762-bc79-4708-9ad1-90bb6919830e None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:10.952537 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb4762-bc79-4708-9ad1-90bb6919830e None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:10.952890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fb4762-bc79-4708-9ad1-90bb6919830e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:10.981101 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-d3fb4762-bc79-4708-9ad1-90bb6919830e None None] MFA Rules not processed for user `2c821c2a732e4f8996382293cc97032d`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:10.982259 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d3fb4762-bc79-4708-9ad1-90bb6919830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:11.006594 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:11.043107 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e628c-287c-49a1-b9c9-47610879f0d9 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:11.066460 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1383/2741] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:11.078329 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb4762-bc79-4708-9ad1-90bb6919830e None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:11.079973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d3fb4762-bc79-4708-9ad1-90bb6919830e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:11.126140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250debe4-c0cb-456b-94b3-47a91c6f0a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:11.126802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250debe4-c0cb-456b-94b3-47a91c6f0a82 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:11.127083 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250debe4-c0cb-456b-94b3-47a91c6f0a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:11.127360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250debe4-c0cb-456b-94b3-47a91c6f0a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:11.129220 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-250debe4-c0cb-456b-94b3-47a91c6f0a82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:11.161334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fb4762-bc79-4708-9ad1-90bb6919830e None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:11.167054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff011791-90fc-4d65-aa00-4293b363f7ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:11.167713 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011791-90fc-4d65-aa00-4293b363f7ed service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:11.167993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011791-90fc-4d65-aa00-4293b363f7ed service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:11.168557 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff011791-90fc-4d65-aa00-4293b363f7ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:11.178015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff011791-90fc-4d65-aa00-4293b363f7ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:11.179155 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff011791-90fc-4d65-aa00-4293b363f7ed service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:11.188869 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1384/2742] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:50:11.201404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250debe4-c0cb-456b-94b3-47a91c6f0a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:11.203824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250debe4-c0cb-456b-94b3-47a91c6f0a82 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:11.216649 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1359/2743] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:11.415569 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff011791-90fc-4d65-aa00-4293b363f7ed service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:11.497862 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff011791-90fc-4d65-aa00-4293b363f7ed service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:11.502679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:11.503782 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:11.504073 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:11.504347 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] PATH_INFO: `/v3/users/2c821c2a732e4f8996382293cc97032d` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:11.505839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c821c2a732e4f8996382293cc97032d)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:11.507880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:11.567411 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c821c2a732e4f8996382293cc97032d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:11.569845 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:11.584373 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c821c2a732e4f8996382293cc97032d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:11.585124 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c821c2a732e4f8996382293cc97032d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:11.600218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c821c2a732e4f8996382293cc97032d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:11.607328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c821c2a732e4f8996382293cc97032d'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:11.615148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1385/2744] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:11 2022] DELETE /identity/v3/users/2c821c2a732e4f8996382293cc97032d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:11.619421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926aaed-88b5-4ed3-8dfb-ff08162e8f85 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:11.619717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926aaed-88b5-4ed3-8dfb-ff08162e8f85 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:11.620002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926aaed-88b5-4ed3-8dfb-ff08162e8f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:11.639708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e926aaed-88b5-4ed3-8dfb-ff08162e8f85 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:11.641961 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e926aaed-88b5-4ed3-8dfb-ff08162e8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:11.693986 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=100 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:11.710506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1360/2745] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:11.720153 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:11.721585 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:11.780324 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2088695-8205-491f-ac6a-734a49d95b5b admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:11.783999 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee01b7d-b75f-4f08-9146-587df4bb0fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:11.784645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee01b7d-b75f-4f08-9146-587df4bb0fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:11.784927 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee01b7d-b75f-4f08-9146-587df4bb0fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:11.785197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee01b7d-b75f-4f08-9146-587df4bb0fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:11.795121 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee01b7d-b75f-4f08-9146-587df4bb0fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:11.796561 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee01b7d-b75f-4f08-9146-587df4bb0fbd service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:11.807013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1386/2746] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:12.091991 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926aaed-88b5-4ed3-8dfb-ff08162e8f85 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.094629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e926aaed-88b5-4ed3-8dfb-ff08162e8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:12.108197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926aaed-88b5-4ed3-8dfb-ff08162e8f85 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.122215 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.123278 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.123565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.123842 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] PATH_INFO: `/v3/projects/59281850bc694d7eb664baa0353286d9` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.125162 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59281850bc694d7eb664baa0353286d9)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.127328 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.176962 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59281850bc694d7eb664baa0353286d9', 'request_id': 'req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:12.184762 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59281850bc694d7eb664baa0353286d9', 'request_id': 'req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:12.191602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59281850bc694d7eb664baa0353286d9', 'request_id': 'req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:12.203919 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] The token cache is being invalidate because project 59281850bc694d7eb664baa0353286d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:12.204207 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:12.204872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-fb9b5bf6-58cd-49bf-a0fa-d973cd6e9e2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:12.206475 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1361/2747] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:12 2022] DELETE /identity/v3/projects/59281850bc694d7eb664baa0353286d9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:12.212344 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce50a3-0298-454a-b4a8-8a7d45a9050d None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.212841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce50a3-0298-454a-b4a8-8a7d45a9050d None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.213154 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce50a3-0298-454a-b4a8-8a7d45a9050d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.233643 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-bbce50a3-0298-454a-b4a8-8a7d45a9050d None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:12.234983 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-bbce50a3-0298-454a-b4a8-8a7d45a9050d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:12.303901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1387/2748] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:12.312927 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402ec0-550d-49bb-9048-970319ad5429 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.313310 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402ec0-550d-49bb-9048-970319ad5429 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.313681 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f402ec0-550d-49bb-9048-970319ad5429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.344856 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-6f402ec0-550d-49bb-9048-970319ad5429 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:12.346066 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-6f402ec0-550d-49bb-9048-970319ad5429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:12.353872 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1362/2749] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:12.358133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce50a3-0298-454a-b4a8-8a7d45a9050d None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.368214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce50a3-0298-454a-b4a8-8a7d45a9050d None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.372871 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eae10-8c26-404d-86a8-fa21f01da662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.373531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eae10-8c26-404d-86a8-fa21f01da662 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.373813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eae10-8c26-404d-86a8-fa21f01da662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.374109 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eae10-8c26-404d-86a8-fa21f01da662 admin admin] PATH_INFO: `/v3/domains` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.375401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eae10-8c26-404d-86a8-fa21f01da662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:50:12.375706 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eae10-8c26-404d-86a8-fa21f01da662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.377315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eae10-8c26-404d-86a8-fa21f01da662 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.392085 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1388/2750] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:50:12.396419 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f402ec0-550d-49bb-9048-970319ad5429 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.406777 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f402ec0-550d-49bb-9048-970319ad5429 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.411438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9c562-de14-4c7c-9688-d60ebe724095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.412090 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9c562-de14-4c7c-9688-d60ebe724095 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.412399 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9c562-de14-4c7c-9688-d60ebe724095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.412673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9c562-de14-4c7c-9688-d60ebe724095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.413360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9c562-de14-4c7c-9688-d60ebe724095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.415293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9c562-de14-4c7c-9688-d60ebe724095 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.443984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1363/2751] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:12 2022] POST /identity/v3/projects => generated 409 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:12.455203 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eae10-8c26-404d-86a8-fa21f01da662 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.461415 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eae10-8c26-404d-86a8-fa21f01da662 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.516494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:12.525051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30e289-282a-49fd-9bff-933b70b005d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.525734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30e289-282a-49fd-9bff-933b70b005d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.527335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30e289-282a-49fd-9bff-933b70b005d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.527795 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b30e289-282a-49fd-9bff-933b70b005d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.528733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30e289-282a-49fd-9bff-933b70b005d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.530793 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b30e289-282a-49fd-9bff-933b70b005d4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.551981 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1389/2752] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:12 2022] POST /identity/v3/users => generated 305 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:50:12.556147 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9c562-de14-4c7c-9688-d60ebe724095 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.566829 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9c562-de14-4c7c-9688-d60ebe724095 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.573200 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9df75-7ea5-47de-81bc-404cadae5f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.573917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9df75-7ea5-47de-81bc-404cadae5f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.574256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9df75-7ea5-47de-81bc-404cadae5f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.574728 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9df75-7ea5-47de-81bc-404cadae5f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.575485 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9df75-7ea5-47de-81bc-404cadae5f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.577356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9df75-7ea5-47de-81bc-404cadae5f57 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.592318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1364/2753] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:12.593679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30e289-282a-49fd-9bff-933b70b005d4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.604025 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b30e289-282a-49fd-9bff-933b70b005d4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.608997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97b9c0-23eb-4227-9b4e-eb6a4d29b838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.609679 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97b9c0-23eb-4227-9b4e-eb6a4d29b838 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.609955 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97b9c0-23eb-4227-9b4e-eb6a4d29b838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.610268 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97b9c0-23eb-4227-9b4e-eb6a4d29b838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.611028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97b9c0-23eb-4227-9b4e-eb6a4d29b838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.612654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d97b9c0-23eb-4227-9b4e-eb6a4d29b838 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.627317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1390/2754] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:12.628276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9df75-7ea5-47de-81bc-404cadae5f57 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.650123 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9df75-7ea5-47de-81bc-404cadae5f57 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.656149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e29c9-dc89-48c0-a2a3-0bab140bc4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.658398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e29c9-dc89-48c0-a2a3-0bab140bc4b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.659042 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e29c9-dc89-48c0-a2a3-0bab140bc4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.659667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e29c9-dc89-48c0-a2a3-0bab140bc4b8 admin admin] PATH_INFO: `/v3/projects/698b75c0b9714b50b0eb1d4b0638c019/users/6f5e31d2341749f19a126fd4c4f6ce21/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.691125 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e29c9-dc89-48c0-a2a3-0bab140bc4b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=698b75c0b9714b50b0eb1d4b0638c019, user_id=6f5e31d2341749f19a126fd4c4f6ce21, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.694741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e29c9-dc89-48c0-a2a3-0bab140bc4b8 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.719079 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1365/2755] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:12 2022] PUT /identity/v3/projects/698b75c0b9714b50b0eb1d4b0638c019/users/6f5e31d2341749f19a126fd4c4f6ce21/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:12.739644 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eba3b-7fe1-465a-96b7-6ba705ccbf15 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.740008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eba3b-7fe1-465a-96b7-6ba705ccbf15 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.740379 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eba3b-7fe1-465a-96b7-6ba705ccbf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.771278 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8d4eba3b-7fe1-465a-96b7-6ba705ccbf15 None None] MFA Rules not processed for user `6f5e31d2341749f19a126fd4c4f6ce21`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:12.773296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8d4eba3b-7fe1-465a-96b7-6ba705ccbf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:12.811699 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e29c9-dc89-48c0-a2a3-0bab140bc4b8 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.814153 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-929e29c9-dc89-48c0-a2a3-0bab140bc4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:12.848668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1391/2756] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:12.853511 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eba3b-7fe1-465a-96b7-6ba705ccbf15 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.877096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e29c9-dc89-48c0-a2a3-0bab140bc4b8 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.881028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d703d-d2f0-471c-a0c5-ab518312223e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.881670 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d703d-d2f0-471c-a0c5-ab518312223e service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.881956 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d703d-d2f0-471c-a0c5-ab518312223e service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.882251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3d703d-d2f0-471c-a0c5-ab518312223e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.884099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7f3d703d-d2f0-471c-a0c5-ab518312223e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:12.907036 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:12.943566 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eba3b-7fe1-465a-96b7-6ba705ccbf15 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:12.948220 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8e7d6-862f-442e-95cb-2b348f8f0850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:12.948833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e7d6-862f-442e-95cb-2b348f8f0850 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:12.949823 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e7d6-862f-442e-95cb-2b348f8f0850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:12.950392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8e7d6-862f-442e-95cb-2b348f8f0850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:12.951293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8e7d6-862f-442e-95cb-2b348f8f0850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.951837 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d703d-d2f0-471c-a0c5-ab518312223e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:12.953302 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3d703d-d2f0-471c-a0c5-ab518312223e service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.953417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8e7d6-862f-442e-95cb-2b348f8f0850 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:12.962544 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1366/2757] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:50:12.986717 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1392/2758] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:12 2022] POST /identity/v3/projects => generated 409 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:12.988104 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d703d-d2f0-471c-a0c5-ab518312223e service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:12.998817 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3d703d-d2f0-471c-a0c5-ab518312223e service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:13.056941 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a92af5-98a9-4602-8eb4-32fc1e2f0627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:13.057710 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a92af5-98a9-4602-8eb4-32fc1e2f0627 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.058034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a92af5-98a9-4602-8eb4-32fc1e2f0627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.058466 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a92af5-98a9-4602-8eb4-32fc1e2f0627 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.059158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a92af5-98a9-4602-8eb4-32fc1e2f0627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:13.061186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a92af5-98a9-4602-8eb4-32fc1e2f0627 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:13.083476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1367/2759] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:12 2022] POST /identity/v3/users => generated 311 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:50:13.090588 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8e7d6-862f-442e-95cb-2b348f8f0850 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:13.101479 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8e7d6-862f-442e-95cb-2b348f8f0850 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:13.106049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a827d0-4998-4d3d-92fe-b47952afe75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:13.106734 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a827d0-4998-4d3d-92fe-b47952afe75a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.107036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a827d0-4998-4d3d-92fe-b47952afe75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.107383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a827d0-4998-4d3d-92fe-b47952afe75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.108143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a827d0-4998-4d3d-92fe-b47952afe75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:13.110397 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a827d0-4998-4d3d-92fe-b47952afe75a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:13.121428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1393/2760] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:13.126011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a92af5-98a9-4602-8eb4-32fc1e2f0627 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:13.137852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a92af5-98a9-4602-8eb4-32fc1e2f0627 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:13.147112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dde6a-8029-4ac0-8e2f-972414519d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:13.147112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dde6a-8029-4ac0-8e2f-972414519d01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.147112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dde6a-8029-4ac0-8e2f-972414519d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.147112 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4dde6a-8029-4ac0-8e2f-972414519d01 admin admin] PATH_INFO: `/v3/projects/bc9dfa9755674d51bd4abc88fdc9fbaf/users/234a958912c9463db980eb051ebf83e8/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.165354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dde6a-8029-4ac0-8e2f-972414519d01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9dfa9755674d51bd4abc88fdc9fbaf, user_id=234a958912c9463db980eb051ebf83e8, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:13.168110 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4dde6a-8029-4ac0-8e2f-972414519d01 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:13.185126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1368/2761] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:13 2022] PUT /identity/v3/projects/bc9dfa9755674d51bd4abc88fdc9fbaf/users/234a958912c9463db980eb051ebf83e8/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:13.189357 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a827d0-4998-4d3d-92fe-b47952afe75a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:13.199831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a827d0-4998-4d3d-92fe-b47952afe75a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:13.238209 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:13.265919 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013c8ed-4020-4b1b-b0bc-6f33dd693557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:13.266665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c8ed-4020-4b1b-b0bc-6f33dd693557 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.266949 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c8ed-4020-4b1b-b0bc-6f33dd693557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.267227 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013c8ed-4020-4b1b-b0bc-6f33dd693557 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.267984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013c8ed-4020-4b1b-b0bc-6f33dd693557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:13.269615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013c8ed-4020-4b1b-b0bc-6f33dd693557 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:13.284140 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1394/2762] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:13.285244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dde6a-8029-4ac0-8e2f-972414519d01 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:13.297228 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4dde6a-8029-4ac0-8e2f-972414519d01 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:13.301999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177ed68-d12e-4ad8-bce2-7d239f3eb8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:13.302955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177ed68-d12e-4ad8-bce2-7d239f3eb8c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.303329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177ed68-d12e-4ad8-bce2-7d239f3eb8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.303713 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177ed68-d12e-4ad8-bce2-7d239f3eb8c0 admin admin] PATH_INFO: `/v3/projects/bc9dfa9755674d51bd4abc88fdc9fbaf/users/234a958912c9463db980eb051ebf83e8/roles/308d9785120a49079e02659953a2b033` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.305864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177ed68-d12e-4ad8-bce2-7d239f3eb8c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9dfa9755674d51bd4abc88fdc9fbaf, user_id=234a958912c9463db980eb051ebf83e8, role_id=308d9785120a49079e02659953a2b033)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:13.308594 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177ed68-d12e-4ad8-bce2-7d239f3eb8c0 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:13.319932 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1369/2763] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:13 2022] PUT /identity/v3/projects/bc9dfa9755674d51bd4abc88fdc9fbaf/users/234a958912c9463db980eb051ebf83e8/roles/308d9785120a49079e02659953a2b033 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:13.332127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a3673-9054-4dc1-986b-5ab48f4755e8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.332448 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a3673-9054-4dc1-986b-5ab48f4755e8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.332861 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a3673-9054-4dc1-986b-5ab48f4755e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.370980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9f6a3673-9054-4dc1-986b-5ab48f4755e8 None None] MFA Rules not processed for user `234a958912c9463db980eb051ebf83e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:13.372116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9f6a3673-9054-4dc1-986b-5ab48f4755e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:13.456555 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1395/2764] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:13.471309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177ed68-d12e-4ad8-bce2-7d239f3eb8c0 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:13.543516 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177ed68-d12e-4ad8-bce2-7d239f3eb8c0 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:13.547366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abecb15-0a3a-420e-b1d4-e5dd00e5ea22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:13.548071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abecb15-0a3a-420e-b1d4-e5dd00e5ea22 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.548392 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abecb15-0a3a-420e-b1d4-e5dd00e5ea22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.548618 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abecb15-0a3a-420e-b1d4-e5dd00e5ea22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.558557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abecb15-0a3a-420e-b1d4-e5dd00e5ea22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:13.560016 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abecb15-0a3a-420e-b1d4-e5dd00e5ea22 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:13.570571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1370/2765] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:13.596290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a3673-9054-4dc1-986b-5ab48f4755e8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:13.597797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9f6a3673-9054-4dc1-986b-5ab48f4755e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:13.610547 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a3673-9054-4dc1-986b-5ab48f4755e8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:13.614792 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f0213-5385-444b-98c3-89f59d963adb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:13.615447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f0213-5385-444b-98c3-89f59d963adb service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.615728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f0213-5385-444b-98c3-89f59d963adb service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.616002 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f0213-5385-444b-98c3-89f59d963adb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.618077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-114f0213-5385-444b-98c3-89f59d963adb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:13.711233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f0213-5385-444b-98c3-89f59d963adb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:13.712833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f0213-5385-444b-98c3-89f59d963adb service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:13.724530 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1396/2766] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:13.799892 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abecb15-0a3a-420e-b1d4-e5dd00e5ea22 service cinder] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:13.810113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abecb15-0a3a-420e-b1d4-e5dd00e5ea22 service cinder] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:13.814950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85518cb7-18c8-4464-9a95-6fe12ac064e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:13.815590 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85518cb7-18c8-4464-9a95-6fe12ac064e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:13.815874 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85518cb7-18c8-4464-9a95-6fe12ac064e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:13.816158 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85518cb7-18c8-4464-9a95-6fe12ac064e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:13.832693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:13.887368 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85518cb7-18c8-4464-9a95-6fe12ac064e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:13.888754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85518cb7-18c8-4464-9a95-6fe12ac064e2 service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:13.898622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1371/2767] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:13 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:50:17.665658 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f0213-5385-444b-98c3-89f59d963adb service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:17.667316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-114f0213-5385-444b-98c3-89f59d963adb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:17.732103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:17.747654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f0213-5385-444b-98c3-89f59d963adb service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:17.752809 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:17.753691 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:17.753966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:17.754266 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] PATH_INFO: `/v3/users/b26d3df5bdba4fa0a67f9c161cee70ad` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:17.756065 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b26d3df5bdba4fa0a67f9c161cee70ad)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:17.757724 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:17.822223 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b26d3df5bdba4fa0a67f9c161cee70ad'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:17.869665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b26d3df5bdba4fa0a67f9c161cee70ad'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:17.870867 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b26d3df5bdba4fa0a67f9c161cee70ad'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:17.891762 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b26d3df5bdba4fa0a67f9c161cee70ad'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:17.903290 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b26d3df5bdba4fa0a67f9c161cee70ad'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:17.914149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1397/2768] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:17 2022] DELETE /identity/v3/users/b26d3df5bdba4fa0a67f9c161cee70ad => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:17.917577 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4612d-66ef-417e-b39e-25a782add83e None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:17.918341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4612d-66ef-417e-b39e-25a782add83e None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:17.918341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4612d-66ef-417e-b39e-25a782add83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:17.939194 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-46c4612d-66ef-417e-b39e-25a782add83e None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:17.940340 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-46c4612d-66ef-417e-b39e-25a782add83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:18.046971 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1372/2769] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:18.058456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:18.060298 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:18.131986 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16766a-3c23-4655-868f-864aeba0a356 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:18.136376 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5baa9-a8d7-4061-b299-a82d84d2f1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:18.137046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5baa9-a8d7-4061-b299-a82d84d2f1bb service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:18.137328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5baa9-a8d7-4061-b299-a82d84d2f1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:18.137605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5baa9-a8d7-4061-b299-a82d84d2f1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:18.147923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5baa9-a8d7-4061-b299-a82d84d2f1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:18.149466 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5baa9-a8d7-4061-b299-a82d84d2f1bb service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:18.160021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1398/2770] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:18.446629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4612d-66ef-417e-b39e-25a782add83e None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:18.448179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-46c4612d-66ef-417e-b39e-25a782add83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:18.461606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4612d-66ef-417e-b39e-25a782add83e None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:18.466389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:18.467268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:18.467550 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:18.468341 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] PATH_INFO: `/v3/projects/a5c34ce4fb4f441fa66cbec3452de114` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:18.469559 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5c34ce4fb4f441fa66cbec3452de114)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:18.471548 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:18.522975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5c34ce4fb4f441fa66cbec3452de114', 'request_id': 'req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:18.531496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5c34ce4fb4f441fa66cbec3452de114', 'request_id': 'req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:18.538174 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5c34ce4fb4f441fa66cbec3452de114', 'request_id': 'req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:18.549476 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] The token cache is being invalidate because project a5c34ce4fb4f441fa66cbec3452de114 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:18.549763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:18.550420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:18.552405 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1373/2771] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:18 2022] DELETE /identity/v3/projects/a5c34ce4fb4f441fa66cbec3452de114 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:18.556149 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5baa9-a8d7-4061-b299-a82d84d2f1bb service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:18.566371 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5baa9-a8d7-4061-b299-a82d84d2f1bb service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:18.624755 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:18.626115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:18.626115 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:18.626378 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] PATH_INFO: `/v3/users/51493d6d66d84219a9a46a427f7cd5d4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:18.627634 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51493d6d66d84219a9a46a427f7cd5d4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:18.629601 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:18.648664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:18.684690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51493d6d66d84219a9a46a427f7cd5d4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:18.694170 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51493d6d66d84219a9a46a427f7cd5d4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:18.694907 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51493d6d66d84219a9a46a427f7cd5d4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:18.710759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51493d6d66d84219a9a46a427f7cd5d4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:18.721543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51493d6d66d84219a9a46a427f7cd5d4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:18.729355 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1399/2772] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:18 2022] DELETE /identity/v3/users/51493d6d66d84219a9a46a427f7cd5d4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:19.038975 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:19.042978 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:19.064940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba141d0d-2fcf-4beb-aa0d-4ea7f57f7b5c admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:19.111330 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:19.146500 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:19.147884 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:19.148296 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:19.148723 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] PATH_INFO: `/v3/projects/ed251aa699e94292b4c10f1b1585ef17` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:19.150595 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed251aa699e94292b4c10f1b1585ef17)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:19.153909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:19.231474 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed251aa699e94292b4c10f1b1585ef17', 'request_id': 'req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.242396 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed251aa699e94292b4c10f1b1585ef17', 'request_id': 'req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.252166 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed251aa699e94292b4c10f1b1585ef17', 'request_id': 'req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.268639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] The token cache is being invalidate because project ed251aa699e94292b4c10f1b1585ef17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:19.269342 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.270236 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.273031 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1374/2773] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:19 2022] DELETE /identity/v3/projects/ed251aa699e94292b4c10f1b1585ef17 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:19.277117 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:19.278951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:19.302863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c05920-5f2c-4d99-97e1-a8953e1e9a14 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:19.375096 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:19.377329 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:19.435625 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:19.437507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:19.437951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:19.438361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] PATH_INFO: `/v3/users/c27ac2f4efa44a95840d315f34fedbe4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:19.440279 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c27ac2f4efa44a95840d315f34fedbe4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:19.443597 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:19.470556 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0200a-b2f3-4c2d-95b2-911f7135c8eb admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:19.476120 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:19.477248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:19.477875 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:19.478197 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] PATH_INFO: `/v3/users/6f5e31d2341749f19a126fd4c4f6ce21` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:19.479453 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f5e31d2341749f19a126fd4c4f6ce21)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:19.481563 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:19.538269 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c27ac2f4efa44a95840d315f34fedbe4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.551446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c27ac2f4efa44a95840d315f34fedbe4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.552749 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c27ac2f4efa44a95840d315f34fedbe4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.570538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c27ac2f4efa44a95840d315f34fedbe4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.576346 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f5e31d2341749f19a126fd4c4f6ce21'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.577067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f5e31d2341749f19a126fd4c4f6ce21'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.578415 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f5e31d2341749f19a126fd4c4f6ce21'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.584021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-b2520a90-930b-47dc-be4b-d57c3670df7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c27ac2f4efa44a95840d315f34fedbe4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.597885 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1400/2774] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:19 2022] DELETE /identity/v3/users/c27ac2f4efa44a95840d315f34fedbe4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:19.615099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f5e31d2341749f19a126fd4c4f6ce21'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.622726 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:19.625057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f5e31d2341749f19a126fd4c4f6ce21'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:19.647673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1375/2775] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:19 2022] DELETE /identity/v3/users/6f5e31d2341749f19a126fd4c4f6ce21 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:19.653013 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abedd3-7582-49b1-8aec-d40f91d922e7 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:19.653307 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abedd3-7582-49b1-8aec-d40f91d922e7 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:19.653619 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abedd3-7582-49b1-8aec-d40f91d922e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:19.675882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-28abedd3-7582-49b1-8aec-d40f91d922e7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:19.678320 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-28abedd3-7582-49b1-8aec-d40f91d922e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:19.688612 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:19.760528 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1401/2776] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:19.775600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:19.777241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:19.850402 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a230b709-4558-4e66-820d-916a36107ce7 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:19.864979 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27fd99-63dd-40b6-9139-7d6474fd0a3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:19.866114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fd99-63dd-40b6-9139-7d6474fd0a3e service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:19.866528 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fd99-63dd-40b6-9139-7d6474fd0a3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:19.866951 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fd99-63dd-40b6-9139-7d6474fd0a3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:19.878135 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27fd99-63dd-40b6-9139-7d6474fd0a3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:19.879636 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27fd99-63dd-40b6-9139-7d6474fd0a3e service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:19.891067 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1376/2777] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:20.196380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abedd3-7582-49b1-8aec-d40f91d922e7 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:20.196746 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-28abedd3-7582-49b1-8aec-d40f91d922e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:20.211131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abedd3-7582-49b1-8aec-d40f91d922e7 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:20.216997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:20.218431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:20.218940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:20.219472 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] PATH_INFO: `/v3/projects/698b75c0b9714b50b0eb1d4b0638c019` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:20.222980 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=698b75c0b9714b50b0eb1d4b0638c019)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:20.225181 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:20.258606 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27fd99-63dd-40b6-9139-7d6474fd0a3e service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:20.261141 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-dc27fd99-63dd-40b6-9139-7d6474fd0a3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:20.277576 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27fd99-63dd-40b6-9139-7d6474fd0a3e service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:20.289233 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '698b75c0b9714b50b0eb1d4b0638c019', 'request_id': 'req-a0848a47-c33c-415d-92a8-b4c4557ed072'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.301356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '698b75c0b9714b50b0eb1d4b0638c019', 'request_id': 'req-a0848a47-c33c-415d-92a8-b4c4557ed072'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.322345 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '698b75c0b9714b50b0eb1d4b0638c019', 'request_id': 'req-a0848a47-c33c-415d-92a8-b4c4557ed072'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.350145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] The token cache is being invalidate because project 698b75c0b9714b50b0eb1d4b0638c019 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:20.350468 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.351111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.352833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1402/2778] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:20 2022] DELETE /identity/v3/projects/698b75c0b9714b50b0eb1d4b0638c019 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:20.357261 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:20.359387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:20.364796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:20.365669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:20.365955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:20.366266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] PATH_INFO: `/v3/projects/f617e90bb8434bdfad1dc226b76f8cb7` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:20.367524 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f617e90bb8434bdfad1dc226b76f8cb7)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:20.369480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:20.373686 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0848a47-c33c-415d-92a8-b4c4557ed072 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:20.381764 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:20.382694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:20.382975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:20.383396 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] PATH_INFO: `/v3/users/234a958912c9463db980eb051ebf83e8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:20.384606 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=234a958912c9463db980eb051ebf83e8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:20.386668 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:20.434767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f617e90bb8434bdfad1dc226b76f8cb7', 'request_id': 'req-0f13da6c-2513-4300-a8b9-724b01056f34'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.442254 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '234a958912c9463db980eb051ebf83e8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.444446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f617e90bb8434bdfad1dc226b76f8cb7', 'request_id': 'req-0f13da6c-2513-4300-a8b9-724b01056f34'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.452923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '234a958912c9463db980eb051ebf83e8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.453145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f617e90bb8434bdfad1dc226b76f8cb7', 'request_id': 'req-0f13da6c-2513-4300-a8b9-724b01056f34'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.453819 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '234a958912c9463db980eb051ebf83e8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.470770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] The token cache is being invalidate because project f617e90bb8434bdfad1dc226b76f8cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:20.472044 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.472747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0f13da6c-2513-4300-a8b9-724b01056f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.474917 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1377/2779] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:20 2022] DELETE /identity/v3/projects/f617e90bb8434bdfad1dc226b76f8cb7 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:20.475289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '234a958912c9463db980eb051ebf83e8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.480635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae6d9f-afa7-43f2-b82c-a29d257050a0 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:20.481059 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae6d9f-afa7-43f2-b82c-a29d257050a0 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:20.481585 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae6d9f-afa7-43f2-b82c-a29d257050a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:20.487638 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-7dea4ff9-1319-4aeb-abf8-eaa9b0f43309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '234a958912c9463db980eb051ebf83e8'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:20.496036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1403/2780] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:20 2022] DELETE /identity/v3/users/234a958912c9463db980eb051ebf83e8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:20.511473 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-e8ae6d9f-afa7-43f2-b82c-a29d257050a0 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:20.512235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-e8ae6d9f-afa7-43f2-b82c-a29d257050a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:20.534486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:20.602526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1378/2781] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:20.612041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a98ee-23b2-4701-b643-a98b9ea3091f None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:20.612380 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a98ee-23b2-4701-b643-a98b9ea3091f None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:20.612710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a98ee-23b2-4701-b643-a98b9ea3091f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:20.651316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-a51a98ee-23b2-4701-b643-a98b9ea3091f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:20.653277 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-a51a98ee-23b2-4701-b643-a98b9ea3091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:20.673833 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1404/2782] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:20.675457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae6d9f-afa7-43f2-b82c-a29d257050a0 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:20.691551 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae6d9f-afa7-43f2-b82c-a29d257050a0 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:20.696628 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb7d47-6135-4f11-abae-907dda6eb7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:20.697163 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb7d47-6135-4f11-abae-907dda6eb7be admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:20.697465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb7d47-6135-4f11-abae-907dda6eb7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:20.697743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb7d47-6135-4f11-abae-907dda6eb7be admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:20.698695 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb7d47-6135-4f11-abae-907dda6eb7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:50:20.698999 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb7d47-6135-4f11-abae-907dda6eb7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:20.700674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb7d47-6135-4f11-abae-907dda6eb7be admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:20.721430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1379/2783] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:50:20.727875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a98ee-23b2-4701-b643-a98b9ea3091f None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:20.735030 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:20.742242 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a98ee-23b2-4701-b643-a98b9ea3091f None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:20.752306 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61774264-b54a-4cb9-93d6-efa5f4ab1fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:20.753176 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61774264-b54a-4cb9-93d6-efa5f4ab1fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:20.753581 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61774264-b54a-4cb9-93d6-efa5f4ab1fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:20.754582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61774264-b54a-4cb9-93d6-efa5f4ab1fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:20.754756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61774264-b54a-4cb9-93d6-efa5f4ab1fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:20.757346 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61774264-b54a-4cb9-93d6-efa5f4ab1fd8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:20.812985 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1405/2784] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:20 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:20.817511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb7d47-6135-4f11-abae-907dda6eb7be admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:20.828506 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb7d47-6135-4f11-abae-907dda6eb7be admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:20.917420 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb459-0c86-4753-9a93-8f30fee36c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:20.918113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb459-0c86-4753-9a93-8f30fee36c51 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:20.919018 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb459-0c86-4753-9a93-8f30fee36c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:20.919018 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb459-0c86-4753-9a93-8f30fee36c51 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:20.919375 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27feb459-0c86-4753-9a93-8f30fee36c51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:20.921925 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27feb459-0c86-4753-9a93-8f30fee36c51 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:20.947609 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1380/2785] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:20 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:50:20.953026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61774264-b54a-4cb9-93d6-efa5f4ab1fd8 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:20.956668 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb459-0c86-4753-9a93-8f30fee36c51 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:20.958732 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-27feb459-0c86-4753-9a93-8f30fee36c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:20.969258 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61774264-b54a-4cb9-93d6-efa5f4ab1fd8 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:20.974571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a053a9-62cb-4db3-bd5e-dc84ca81ab42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:20.974751 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb459-0c86-4753-9a93-8f30fee36c51 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:20.976003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a053a9-62cb-4db3-bd5e-dc84ca81ab42 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:20.976415 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a053a9-62cb-4db3-bd5e-dc84ca81ab42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:20.976834 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a053a9-62cb-4db3-bd5e-dc84ca81ab42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:20.978000 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a053a9-62cb-4db3-bd5e-dc84ca81ab42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:20.979835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a053a9-62cb-4db3-bd5e-dc84ca81ab42 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:20.979969 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:20.980960 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:20.981358 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:20.981705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] PATH_INFO: `/v3/projects/bc9dfa9755674d51bd4abc88fdc9fbaf` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:20.984955 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9dfa9755674d51bd4abc88fdc9fbaf)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:20.987008 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:20.997971 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1406/2786] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:21.002609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a053a9-62cb-4db3-bd5e-dc84ca81ab42 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:21.013008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a053a9-62cb-4db3-bd5e-dc84ca81ab42 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:21.018252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af6285-bdd9-4e52-916f-70bf247cc395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:21.018951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af6285-bdd9-4e52-916f-70bf247cc395 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.019232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af6285-bdd9-4e52-916f-70bf247cc395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.019507 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af6285-bdd9-4e52-916f-70bf247cc395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.020230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af6285-bdd9-4e52-916f-70bf247cc395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:21.021840 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af6285-bdd9-4e52-916f-70bf247cc395 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:21.040076 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1407/2787] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:50:21.041420 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af6285-bdd9-4e52-916f-70bf247cc395 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:21.048131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9dfa9755674d51bd4abc88fdc9fbaf', 'request_id': 'req-bf2fbb89-d1af-484f-bd35-bc92ef9490be'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:21.052296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af6285-bdd9-4e52-916f-70bf247cc395 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:21.057540 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9dfa9755674d51bd4abc88fdc9fbaf', 'request_id': 'req-bf2fbb89-d1af-484f-bd35-bc92ef9490be'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:21.066009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9dfa9755674d51bd4abc88fdc9fbaf', 'request_id': 'req-bf2fbb89-d1af-484f-bd35-bc92ef9490be'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:21.077209 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] The token cache is being invalidate because project bc9dfa9755674d51bd4abc88fdc9fbaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80476) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:21.077499 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:21.078398 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-bf2fbb89-d1af-484f-bd35-bc92ef9490be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:21.079990 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1381/2788] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:20 2022] DELETE /identity/v3/projects/bc9dfa9755674d51bd4abc88fdc9fbaf => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:21.085652 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d097c-b51b-43bf-9155-201be2246985 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.086071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d097c-b51b-43bf-9155-201be2246985 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.086461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d097c-b51b-43bf-9155-201be2246985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.106696 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-5c8d097c-b51b-43bf-9155-201be2246985 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:21.108004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-5c8d097c-b51b-43bf-9155-201be2246985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:21.121611 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5441b3-b392-498f-9ace-b031c2c73eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:21.122589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5441b3-b392-498f-9ace-b031c2c73eb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.122880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5441b3-b392-498f-9ace-b031c2c73eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.123165 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5441b3-b392-498f-9ace-b031c2c73eb7 admin admin] PATH_INFO: `/v3/projects/6caddc6b48ad479b922f4eef9841ce0f/users/8d0c587d01ac44b79972e49a5f0aeeee/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.130047 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:21.140304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5441b3-b392-498f-9ace-b031c2c73eb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6caddc6b48ad479b922f4eef9841ce0f, user_id=8d0c587d01ac44b79972e49a5f0aeeee, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:21.143184 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5441b3-b392-498f-9ace-b031c2c73eb7 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:21.163033 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1408/2789] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:21 2022] PUT /identity/v3/projects/6caddc6b48ad479b922f4eef9841ce0f/users/8d0c587d01ac44b79972e49a5f0aeeee/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:21.170367 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072d69b-1290-44d2-bb91-534e9f897ce8 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.170659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072d69b-1290-44d2-bb91-534e9f897ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.171756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072d69b-1290-44d2-bb91-534e9f897ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.194072 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c072d69b-1290-44d2-bb91-534e9f897ce8 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:21.195521 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c072d69b-1290-44d2-bb91-534e9f897ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:21.205206 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1382/2790] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:21.213281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf01b00-e3bc-48e2-b4fb-71b68d81a0e9 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.213592 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf01b00-e3bc-48e2-b4fb-71b68d81a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.213862 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf01b00-e3bc-48e2-b4fb-71b68d81a0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.235894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-1bf01b00-e3bc-48e2-b4fb-71b68d81a0e9 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:21.237164 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-1bf01b00-e3bc-48e2-b4fb-71b68d81a0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:21.265587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1409/2791] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:21.276111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072d69b-1290-44d2-bb91-534e9f897ce8 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:21.277548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c072d69b-1290-44d2-bb91-534e9f897ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:21.302578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1383/2792] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:21.306809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf01b00-e3bc-48e2-b4fb-71b68d81a0e9 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:21.315915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf01b00-e3bc-48e2-b4fb-71b68d81a0e9 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:21.320598 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c89ac-27a7-45e9-98a4-ebefc7a70c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:21.321259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c89ac-27a7-45e9-98a4-ebefc7a70c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.321554 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c89ac-27a7-45e9-98a4-ebefc7a70c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.321825 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c89ac-27a7-45e9-98a4-ebefc7a70c4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.322597 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c89ac-27a7-45e9-98a4-ebefc7a70c4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:50:21.322909 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c89ac-27a7-45e9-98a4-ebefc7a70c4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:21.324539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c89ac-27a7-45e9-98a4-ebefc7a70c4f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:21.326491 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:21.340735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1384/2793] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:50:21.340951 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c072d69b-1290-44d2-bb91-534e9f897ce8 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:21.342380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c89ac-27a7-45e9-98a4-ebefc7a70c4f admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:21.346201 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55876d-5a49-4fa9-bd09-23944b030d7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:21.346870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55876d-5a49-4fa9-bd09-23944b030d7e service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.347151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55876d-5a49-4fa9-bd09-23944b030d7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.347431 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b55876d-5a49-4fa9-bd09-23944b030d7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.353131 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c89ac-27a7-45e9-98a4-ebefc7a70c4f admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:21.357549 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55876d-5a49-4fa9-bd09-23944b030d7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:21.359132 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b55876d-5a49-4fa9-bd09-23944b030d7e service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:21.359256 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f814092-7f7b-41aa-ba64-56d07fe78940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:21.360099 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f814092-7f7b-41aa-ba64-56d07fe78940 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.360385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f814092-7f7b-41aa-ba64-56d07fe78940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.360667 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f814092-7f7b-41aa-ba64-56d07fe78940 admin admin] PATH_INFO: `/v3/projects` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.361369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f814092-7f7b-41aa-ba64-56d07fe78940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:21.363354 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f814092-7f7b-41aa-ba64-56d07fe78940 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:21.369860 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1410/2794] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:50:21.399693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1385/2795] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:21 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:50:21.406446 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55876d-5a49-4fa9-bd09-23944b030d7e service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:21.414628 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b55876d-5a49-4fa9-bd09-23944b030d7e service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:21.480984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18985e72-79eb-46a8-a240-2bee830f1f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:21.481728 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985e72-79eb-46a8-a240-2bee830f1f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.482046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985e72-79eb-46a8-a240-2bee830f1f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.482480 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18985e72-79eb-46a8-a240-2bee830f1f98 admin admin] PATH_INFO: `/v3/users` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.483197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18985e72-79eb-46a8-a240-2bee830f1f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:21.485192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18985e72-79eb-46a8-a240-2bee830f1f98 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:21.510948 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1411/2796] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:21 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:21.512483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f814092-7f7b-41aa-ba64-56d07fe78940 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:21.523746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f814092-7f7b-41aa-ba64-56d07fe78940 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:21.531388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18955f54-45a8-47c2-ae05-40bf4e2e02f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:21.531388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18955f54-45a8-47c2-ae05-40bf4e2e02f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.531388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18955f54-45a8-47c2-ae05-40bf4e2e02f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.531388 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18955f54-45a8-47c2-ae05-40bf4e2e02f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.531813 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18955f54-45a8-47c2-ae05-40bf4e2e02f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:21.533009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18955f54-45a8-47c2-ae05-40bf4e2e02f9 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:21.547364 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1386/2797] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:21.548694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18985e72-79eb-46a8-a240-2bee830f1f98 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:21.560191 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18985e72-79eb-46a8-a240-2bee830f1f98 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:21.566120 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4e514-3d0d-428a-8177-66b36b5ca2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:21.566831 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4e514-3d0d-428a-8177-66b36b5ca2dc admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.567139 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4e514-3d0d-428a-8177-66b36b5ca2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.567421 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4e514-3d0d-428a-8177-66b36b5ca2dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.568158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4e514-3d0d-428a-8177-66b36b5ca2dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:21.569916 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4e514-3d0d-428a-8177-66b36b5ca2dc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:21.585015 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1412/2798] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 14:50:21.586267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18955f54-45a8-47c2-ae05-40bf4e2e02f9 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:21.598312 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18955f54-45a8-47c2-ae05-40bf4e2e02f9 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:21.605959 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b2b9-204e-4df3-8eb3-8c1699d0a06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:21.607306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b2b9-204e-4df3-8eb3-8c1699d0a06f admin admin] REQUEST_METHOD: `PUT` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.607769 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b2b9-204e-4df3-8eb3-8c1699d0a06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.608219 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66b2b9-204e-4df3-8eb3-8c1699d0a06f admin admin] PATH_INFO: `/v3/projects/d11d60b1d34446cbbe5d3043041e66c4/users/6b54c1c7308f44fabf27471bf2f25a7f/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.629300 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66b2b9-204e-4df3-8eb3-8c1699d0a06f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11d60b1d34446cbbe5d3043041e66c4, user_id=6b54c1c7308f44fabf27471bf2f25a7f, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:21.632426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d66b2b9-204e-4df3-8eb3-8c1699d0a06f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:21.662439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1387/2799] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:21 2022] PUT /identity/v3/projects/d11d60b1d34446cbbe5d3043041e66c4/users/6b54c1c7308f44fabf27471bf2f25a7f/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:21.666751 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3cfa3-95dd-4b0d-af75-685f8fe49423 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.667050 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3cfa3-95dd-4b0d-af75-685f8fe49423 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.667334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3cfa3-95dd-4b0d-af75-685f8fe49423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.701406 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-17b3cfa3-95dd-4b0d-af75-685f8fe49423 None None] MFA Rules not processed for user `6b54c1c7308f44fabf27471bf2f25a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:21.703388 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-17b3cfa3-95dd-4b0d-af75-685f8fe49423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:21.850385 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1413/2800] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:21.863558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b2b9-204e-4df3-8eb3-8c1699d0a06f admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:21.865602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4d66b2b9-204e-4df3-8eb3-8c1699d0a06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:21.963801 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d66b2b9-204e-4df3-8eb3-8c1699d0a06f admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:21.971002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435188ef-0b40-4af2-916e-288c2589c587 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0edbf66359f1426999f4c28a83f2bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:21.971679 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435188ef-0b40-4af2-916e-288c2589c587 service glance] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:21.971965 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435188ef-0b40-4af2-916e-288c2589c587 service glance] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:21.972244 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435188ef-0b40-4af2-916e-288c2589c587 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:21.980616 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:21.984418 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435188ef-0b40-4af2-916e-288c2589c587 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:21.987057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435188ef-0b40-4af2-916e-288c2589c587 service glance] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:21.999950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1388/2801] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:22.415011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143a59a-adb6-484b-96b4-4f4c678476a6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:22.415293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143a59a-adb6-484b-96b4-4f4c678476a6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:22.415587 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1143a59a-adb6-484b-96b4-4f4c678476a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:22.449994 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-1143a59a-adb6-484b-96b4-4f4c678476a6 None None] MFA Rules not processed for user `8d0c587d01ac44b79972e49a5f0aeeee`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:22.450627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1143a59a-adb6-484b-96b4-4f4c678476a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:22.516510 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:22.559841 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1414/2802] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:22.577629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435188ef-0b40-4af2-916e-288c2589c587 service glance] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:22.579693 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-435188ef-0b40-4af2-916e-288c2589c587 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:22.657171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435188ef-0b40-4af2-916e-288c2589c587 service glance] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:22.662232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17656757-643e-4150-9371-87f9640fed4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:22.662977 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656757-643e-4150-9371-87f9640fed4a service cinder] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:22.663266 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656757-643e-4150-9371-87f9640fed4a service cinder] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:22.663542 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17656757-643e-4150-9371-87f9640fed4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:22.673434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17656757-643e-4150-9371-87f9640fed4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:22.675032 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17656757-643e-4150-9371-87f9640fed4a service cinder] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:22.684924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1389/2803] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:22.933870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143a59a-adb6-484b-96b4-4f4c678476a6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:23.025211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1143a59a-adb6-484b-96b4-4f4c678476a6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:23.031611 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf165-32b6-4709-97dd-3edd202f5f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:23.032908 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf165-32b6-4709-97dd-3edd202f5f05 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:23.033311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf165-32b6-4709-97dd-3edd202f5f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:23.033667 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21adf165-32b6-4709-97dd-3edd202f5f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:23.036017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-21adf165-32b6-4709-97dd-3edd202f5f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:23.118664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf165-32b6-4709-97dd-3edd202f5f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:23.120189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21adf165-32b6-4709-97dd-3edd202f5f05 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:23.131300 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1415/2804] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:24.083139 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb8a5-5309-43a1-8d4e-f6c3956c1fe7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:24.083997 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb8a5-5309-43a1-8d4e-f6c3956c1fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:24.084269 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebfb8a5-5309-43a1-8d4e-f6c3956c1fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:24.106270 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-eebfb8a5-5309-43a1-8d4e-f6c3956c1fe7 None None] MFA Rules not processed for user `8d0c587d01ac44b79972e49a5f0aeeee`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:24.107573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-eebfb8a5-5309-43a1-8d4e-f6c3956c1fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:24.115973 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1390/2805] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:24.399584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf165-32b6-4709-97dd-3edd202f5f05 service neutron] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:24.401077 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-21adf165-32b6-4709-97dd-3edd202f5f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:24.412816 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21adf165-32b6-4709-97dd-3edd202f5f05 service neutron] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:24.416931 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d37582-58bd-4824-8e01-54234e5691a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:24.417592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d37582-58bd-4824-8e01-54234e5691a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:24.417879 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d37582-58bd-4824-8e01-54234e5691a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:24.418188 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d37582-58bd-4824-8e01-54234e5691a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:24.419993 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d6d37582-58bd-4824-8e01-54234e5691a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:24.435186 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d37582-58bd-4824-8e01-54234e5691a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:24.436826 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d37582-58bd-4824-8e01-54234e5691a9 service neutron] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:24.446207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1416/2806] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:29.555983 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfb8a5-5309-43a1-8d4e-f6c3956c1fe7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:29.557930 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-eebfb8a5-5309-43a1-8d4e-f6c3956c1fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:29.572886 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebfb8a5-5309-43a1-8d4e-f6c3956c1fe7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:29.578513 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:29.579497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:29.579852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:29.580222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] PATH_INFO: `/v3/users/673e42b791cc4eb0864a3ff0e7e9de54` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:29.581523 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] RBAC: Authorizing `identity:delete_user(user_id=673e42b791cc4eb0864a3ff0e7e9de54)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:29.583589 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:29.640899 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673e42b791cc4eb0864a3ff0e7e9de54'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:29.641858 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673e42b791cc4eb0864a3ff0e7e9de54'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:29.642673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673e42b791cc4eb0864a3ff0e7e9de54'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:29.657347 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673e42b791cc4eb0864a3ff0e7e9de54'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:29.672719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673e42b791cc4eb0864a3ff0e7e9de54'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:29.686027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1391/2807] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:29 2022] DELETE /identity/v3/users/673e42b791cc4eb0864a3ff0e7e9de54 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:29.691392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973fde2-a8da-4b4a-a0f9-4df5f98dd3f9 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:29.691930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973fde2-a8da-4b4a-a0f9-4df5f98dd3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:29.691930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973fde2-a8da-4b4a-a0f9-4df5f98dd3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:29.725428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-8973fde2-a8da-4b4a-a0f9-4df5f98dd3f9 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:29.726846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8973fde2-a8da-4b4a-a0f9-4df5f98dd3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:29.827218 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1417/2808] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:29.882027 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:29.884430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:29.979622 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ae824-fa35-4e1b-bc95-314ad810382e admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:29.985895 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf92224-39bf-42e6-8b26-c6508fc52ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:29.990205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf92224-39bf-42e6-8b26-c6508fc52ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:29.990205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf92224-39bf-42e6-8b26-c6508fc52ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:29.990205 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf92224-39bf-42e6-8b26-c6508fc52ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:30.012259 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf92224-39bf-42e6-8b26-c6508fc52ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:30.013746 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf92224-39bf-42e6-8b26-c6508fc52ca8 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:30.026319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1392/2809] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:30.638157 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973fde2-a8da-4b4a-a0f9-4df5f98dd3f9 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:30.640353 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-8973fde2-a8da-4b4a-a0f9-4df5f98dd3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:30.660319 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973fde2-a8da-4b4a-a0f9-4df5f98dd3f9 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:30.666669 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:30.668467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:30.676950 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:30.677564 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] PATH_INFO: `/v3/projects/4cd2f43c4c044ef5b129a7f5c405c367` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:30.679089 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd2f43c4c044ef5b129a7f5c405c367)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:30.681147 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:30.703016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:30.739383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd2f43c4c044ef5b129a7f5c405c367', 'request_id': 'req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:30.752959 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd2f43c4c044ef5b129a7f5c405c367', 'request_id': 'req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:30.760338 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd2f43c4c044ef5b129a7f5c405c367', 'request_id': 'req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:30.772028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] The token cache is being invalidate because project 4cd2f43c4c044ef5b129a7f5c405c367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:30.772359 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:30.773051 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:30.775274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1418/2810] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:30 2022] DELETE /identity/v3/projects/4cd2f43c4c044ef5b129a7f5c405c367 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:32.411489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf92224-39bf-42e6-8b26-c6508fc52ca8 service neutron] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:32.414281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ebf92224-39bf-42e6-8b26-c6508fc52ca8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:32.433737 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf92224-39bf-42e6-8b26-c6508fc52ca8 service neutron] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:32.439171 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:32.499202 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:32.500009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:32.500292 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:32.500566 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] PATH_INFO: `/v3/users/aefddca517e84383b411886358ef0651` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:32.501897 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aefddca517e84383b411886358ef0651)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:32.503915 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:32.557526 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aefddca517e84383b411886358ef0651'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:32.558383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aefddca517e84383b411886358ef0651'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:32.559178 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aefddca517e84383b411886358ef0651'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:32.578417 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aefddca517e84383b411886358ef0651'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:32.586070 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aefddca517e84383b411886358ef0651'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:32.600242 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1393/2811] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:32 2022] DELETE /identity/v3/users/aefddca517e84383b411886358ef0651 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:32.800710 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:32.802328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:32.816690 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d63fa-8fdd-41b4-8b54-bf651f25d9ef admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:32.884953 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:32.885893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:32.886207 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:32.886487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] PATH_INFO: `/v3/projects/5c9c69b24fe84b8080b35abaee586f31` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:32.887775 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c9c69b24fe84b8080b35abaee586f31)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:32.890422 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:32.944289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c9c69b24fe84b8080b35abaee586f31', 'request_id': 'req-130a3d7a-fd0a-4cd3-a735-5f84e460c686'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:32.952486 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c9c69b24fe84b8080b35abaee586f31', 'request_id': 'req-130a3d7a-fd0a-4cd3-a735-5f84e460c686'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:32.962061 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c9c69b24fe84b8080b35abaee586f31', 'request_id': 'req-130a3d7a-fd0a-4cd3-a735-5f84e460c686'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:32.975105 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] The token cache is being invalidate because project 5c9c69b24fe84b8080b35abaee586f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:32.975398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:32.976057 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:32.977655 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1419/2812] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:32 2022] DELETE /identity/v3/projects/5c9c69b24fe84b8080b35abaee586f31 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:50:32.984602 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:32.986069 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:32.999898 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368577db-117a-4da0-8b0a-2cb05077cad5 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:33.068809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:33.069730 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:33.070009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:33.070313 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] PATH_INFO: `/v3/users/4b25c9a4425945ba9e86d89f103d7834` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:33.072277 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b25c9a4425945ba9e86d89f103d7834)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:33.073712 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:33.128075 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:33.158741 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b25c9a4425945ba9e86d89f103d7834'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:33.159426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b25c9a4425945ba9e86d89f103d7834'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:33.160040 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b25c9a4425945ba9e86d89f103d7834'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:33.179039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b25c9a4425945ba9e86d89f103d7834'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:33.186386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b25c9a4425945ba9e86d89f103d7834'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:33.205824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1394/2813] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:32 2022] DELETE /identity/v3/users/4b25c9a4425945ba9e86d89f103d7834 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:33.432021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:33.433487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:33.448014 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a3d7a-fd0a-4cd3-a735-5f84e460c686 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:33.507736 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:33.550890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:33.552450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:33.552940 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:33.553451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] PATH_INFO: `/v3/projects/eae5cb96ff1b4a45aaa415a9c30c64b4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:33.555596 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eae5cb96ff1b4a45aaa415a9c30c64b4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:33.559317 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:33.648933 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eae5cb96ff1b4a45aaa415a9c30c64b4', 'request_id': 'req-a042a828-baa0-4bb3-9785-cde47fa65bd1'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:33.664703 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eae5cb96ff1b4a45aaa415a9c30c64b4', 'request_id': 'req-a042a828-baa0-4bb3-9785-cde47fa65bd1'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:33.677119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eae5cb96ff1b4a45aaa415a9c30c64b4', 'request_id': 'req-a042a828-baa0-4bb3-9785-cde47fa65bd1'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:33.690818 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] The token cache is being invalidate because project eae5cb96ff1b4a45aaa415a9c30c64b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:33.691113 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:33.691777 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-a042a828-baa0-4bb3-9785-cde47fa65bd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:33.693546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1420/2814] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:33 2022] DELETE /identity/v3/projects/eae5cb96ff1b4a45aaa415a9c30c64b4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:37.864231 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:37.865894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:37.879006 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc290191-a74b-4eae-ad24-fdfd197352c5 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:37.937757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:37.938680 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:37.938963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:37.939243 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] PATH_INFO: `/v3/users/6b54c1c7308f44fabf27471bf2f25a7f` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:37.940465 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b54c1c7308f44fabf27471bf2f25a7f)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:37.942421 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:38.001186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b54c1c7308f44fabf27471bf2f25a7f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:38.002203 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b54c1c7308f44fabf27471bf2f25a7f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:38.002907 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b54c1c7308f44fabf27471bf2f25a7f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:38.021386 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b54c1c7308f44fabf27471bf2f25a7f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:38.032383 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b54c1c7308f44fabf27471bf2f25a7f'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:38.049565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1395/2815] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:37 2022] DELETE /identity/v3/users/6b54c1c7308f44fabf27471bf2f25a7f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:38.054131 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee612-cbf2-40cf-98a9-08060c251230 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.054651 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee612-cbf2-40cf-98a9-08060c251230 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:38.054846 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ee612-cbf2-40cf-98a9-08060c251230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:38.076031 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-c30ee612-cbf2-40cf-98a9-08060c251230 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:38.078326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c30ee612-cbf2-40cf-98a9-08060c251230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:38.145946 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1421/2816] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:50:38.156442 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:38.157894 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:38.187284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:38.226729 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e5738-c163-46c7-b762-afb594946098 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:38.232304 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10a609-8bc8-432a-ba1e-47f646e1b9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:38.232972 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a609-8bc8-432a-ba1e-47f646e1b9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.233254 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a609-8bc8-432a-ba1e-47f646e1b9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:38.233529 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10a609-8bc8-432a-ba1e-47f646e1b9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:38.243515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a609-8bc8-432a-ba1e-47f646e1b9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:38.245306 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10a609-8bc8-432a-ba1e-47f646e1b9a8 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:38.258558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1396/2817] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:38.557158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee612-cbf2-40cf-98a9-08060c251230 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:38.558626 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c30ee612-cbf2-40cf-98a9-08060c251230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:38.574958 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ee612-cbf2-40cf-98a9-08060c251230 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:38.581918 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:38.582859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.583143 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:38.583420 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] PATH_INFO: `/v3/projects/d11d60b1d34446cbbe5d3043041e66c4` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:38.584674 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11d60b1d34446cbbe5d3043041e66c4)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:38.586699 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:38.644500 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11d60b1d34446cbbe5d3043041e66c4', 'request_id': 'req-cfa1cf3a-09a9-4fda-86df-04890fb54042'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:38.658135 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11d60b1d34446cbbe5d3043041e66c4', 'request_id': 'req-cfa1cf3a-09a9-4fda-86df-04890fb54042'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:38.659661 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:38.664904 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11d60b1d34446cbbe5d3043041e66c4', 'request_id': 'req-cfa1cf3a-09a9-4fda-86df-04890fb54042'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:38.689798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] The token cache is being invalidate because project d11d60b1d34446cbbe5d3043041e66c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:38.690224 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:38.691008 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-cfa1cf3a-09a9-4fda-86df-04890fb54042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:38.692656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1422/2818] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:38 2022] DELETE /identity/v3/projects/d11d60b1d34446cbbe5d3043041e66c4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:38.697852 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb987d46-14a1-4399-9a03-d710d8f9b4e7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.698248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb987d46-14a1-4399-9a03-d710d8f9b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:38.698525 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb987d46-14a1-4399-9a03-d710d8f9b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:38.720912 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-bb987d46-14a1-4399-9a03-d710d8f9b4e7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:38.722214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-bb987d46-14a1-4399-9a03-d710d8f9b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:38.790775 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1397/2819] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:38.799401 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6976d2-33a3-41b2-b431-a8f05f2d4588 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.799696 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6976d2-33a3-41b2-b431-a8f05f2d4588 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:38.799975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6976d2-33a3-41b2-b431-a8f05f2d4588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:38.819875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-3e6976d2-33a3-41b2-b431-a8f05f2d4588 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:38.821084 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-3e6976d2-33a3-41b2-b431-a8f05f2d4588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:38.829657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1423/2820] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:38.833854 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb987d46-14a1-4399-9a03-d710d8f9b4e7 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:38.844183 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb987d46-14a1-4399-9a03-d710d8f9b4e7 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:38.849005 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93cd0-6e18-4462-b09f-43811b94dc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:38.849675 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93cd0-6e18-4462-b09f-43811b94dc23 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.849957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93cd0-6e18-4462-b09f-43811b94dc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:38.850284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d93cd0-6e18-4462-b09f-43811b94dc23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:38.851033 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d93cd0-6e18-4462-b09f-43811b94dc23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:50:38.851350 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d93cd0-6e18-4462-b09f-43811b94dc23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:38.852976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d93cd0-6e18-4462-b09f-43811b94dc23 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:38.866532 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1398/2821] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:50:38.871067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6976d2-33a3-41b2-b431-a8f05f2d4588 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:38.881633 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6976d2-33a3-41b2-b431-a8f05f2d4588 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:38.886685 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695bbb2-5d06-45a2-a0b1-da26fa42962a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:38.887573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695bbb2-5d06-45a2-a0b1-da26fa42962a admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.888046 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695bbb2-5d06-45a2-a0b1-da26fa42962a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:38.888387 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695bbb2-5d06-45a2-a0b1-da26fa42962a admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:38.889197 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695bbb2-5d06-45a2-a0b1-da26fa42962a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:38.891211 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b695bbb2-5d06-45a2-a0b1-da26fa42962a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:38.921920 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1424/2822] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:38 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:38.924165 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93cd0-6e18-4462-b09f-43811b94dc23 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:38.935538 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d93cd0-6e18-4462-b09f-43811b94dc23 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:38.999002 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b940fa-cec3-4dab-aa8b-14061696c2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:38.999673 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b940fa-cec3-4dab-aa8b-14061696c2ac admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:38.999957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b940fa-cec3-4dab-aa8b-14061696c2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:39.000232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b940fa-cec3-4dab-aa8b-14061696c2ac admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:39.000940 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b940fa-cec3-4dab-aa8b-14061696c2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:39.002957 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b940fa-cec3-4dab-aa8b-14061696c2ac admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:39.025034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1399/2823] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:38 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:50:39.029172 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695bbb2-5d06-45a2-a0b1-da26fa42962a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:39.040733 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695bbb2-5d06-45a2-a0b1-da26fa42962a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:39.048066 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db807f8-a9b4-45bb-b45d-89e0d90b235a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:39.048754 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db807f8-a9b4-45bb-b45d-89e0d90b235a admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:39.049039 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db807f8-a9b4-45bb-b45d-89e0d90b235a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:39.049315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db807f8-a9b4-45bb-b45d-89e0d90b235a admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:39.050044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db807f8-a9b4-45bb-b45d-89e0d90b235a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:39.051692 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db807f8-a9b4-45bb-b45d-89e0d90b235a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:39.063383 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1425/2824] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:39.069232 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b940fa-cec3-4dab-aa8b-14061696c2ac admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:39.082251 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b940fa-cec3-4dab-aa8b-14061696c2ac admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:39.087558 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924131ac-367e-4c9a-a895-35ab1fbbf6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:39.088498 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924131ac-367e-4c9a-a895-35ab1fbbf6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:39.088799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924131ac-367e-4c9a-a895-35ab1fbbf6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:39.089077 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924131ac-367e-4c9a-a895-35ab1fbbf6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:39.089824 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924131ac-367e-4c9a-a895-35ab1fbbf6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:39.091489 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924131ac-367e-4c9a-a895-35ab1fbbf6c4 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:39.103479 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1400/2825] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:39.108358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db807f8-a9b4-45bb-b45d-89e0d90b235a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:39.118641 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db807f8-a9b4-45bb-b45d-89e0d90b235a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:39.123659 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675140ff-2bd9-4400-bf39-edc3f919a828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:39.124548 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675140ff-2bd9-4400-bf39-edc3f919a828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:39.124827 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675140ff-2bd9-4400-bf39-edc3f919a828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:39.125099 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675140ff-2bd9-4400-bf39-edc3f919a828 admin admin] PATH_INFO: `/v3/projects/a8042f2d27c4412fb84c7c9800c41ef8/users/0c7c78ede28e4365a9f3379e60ab9b09/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:39.142525 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675140ff-2bd9-4400-bf39-edc3f919a828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8042f2d27c4412fb84c7c9800c41ef8, user_id=0c7c78ede28e4365a9f3379e60ab9b09, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:39.145106 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675140ff-2bd9-4400-bf39-edc3f919a828 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:39.163434 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1426/2826] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:39 2022] PUT /identity/v3/projects/a8042f2d27c4412fb84c7c9800c41ef8/users/0c7c78ede28e4365a9f3379e60ab9b09/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:39.174225 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea488407-f716-48f7-81b7-2d662e4e6cc1 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:39.174519 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea488407-f716-48f7-81b7-2d662e4e6cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:39.174809 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea488407-f716-48f7-81b7-2d662e4e6cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:39.204463 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-ea488407-f716-48f7-81b7-2d662e4e6cc1 None None] MFA Rules not processed for user `0c7c78ede28e4365a9f3379e60ab9b09`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:39.205690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ea488407-f716-48f7-81b7-2d662e4e6cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:39.228177 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:39.280621 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1401/2827] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:39.291226 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675140ff-2bd9-4400-bf39-edc3f919a828 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:39.293004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-675140ff-2bd9-4400-bf39-edc3f919a828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:39.355584 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675140ff-2bd9-4400-bf39-edc3f919a828 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:39.363096 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6afda4-2eb1-4340-aa59-a3074a48e3da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:39.363758 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6afda4-2eb1-4340-aa59-a3074a48e3da service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:39.364042 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6afda4-2eb1-4340-aa59-a3074a48e3da service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:39.364316 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6afda4-2eb1-4340-aa59-a3074a48e3da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:39.373519 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6afda4-2eb1-4340-aa59-a3074a48e3da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:39.375003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6afda4-2eb1-4340-aa59-a3074a48e3da service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:39.384687 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1427/2828] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:42.465882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea488407-f716-48f7-81b7-2d662e4e6cc1 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:42.535385 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea488407-f716-48f7-81b7-2d662e4e6cc1 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:42.540022 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:42.540935 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:42.541316 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:42.541596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] PATH_INFO: `/v3/users/0c7c78ede28e4365a9f3379e60ab9b09` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:42.542830 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c7c78ede28e4365a9f3379e60ab9b09)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:42.544767 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:42.597073 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c7c78ede28e4365a9f3379e60ab9b09'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:42.597768 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c7c78ede28e4365a9f3379e60ab9b09'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:42.598461 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c7c78ede28e4365a9f3379e60ab9b09'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:42.611565 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c7c78ede28e4365a9f3379e60ab9b09'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:42.619627 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c7c78ede28e4365a9f3379e60ab9b09'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:42.635446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1402/2829] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:50:42 2022] DELETE /identity/v3/users/0c7c78ede28e4365a9f3379e60ab9b09 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:42.640560 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8fa3d-7c2f-4aa5-aebf-d2f3a8a562a5 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:42.641045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8fa3d-7c2f-4aa5-aebf-d2f3a8a562a5 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:42.641145 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca8fa3d-7c2f-4aa5-aebf-d2f3a8a562a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:42.660591 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-9ca8fa3d-7c2f-4aa5-aebf-d2f3a8a562a5 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:42.661884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9ca8fa3d-7c2f-4aa5-aebf-d2f3a8a562a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:42.728214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1428/2830] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:42.738743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:42.740241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:42.788799 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:42.804248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27163377-7b0c-41c3-8945-100f1f4f5632 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:42.808050 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a6aec-eaa1-4dcc-b0a9-8d1e503e2f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:42.808702 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6aec-eaa1-4dcc-b0a9-8d1e503e2f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:42.808985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6aec-eaa1-4dcc-b0a9-8d1e503e2f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:42.809439 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a6aec-eaa1-4dcc-b0a9-8d1e503e2f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:42.819484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a6aec-eaa1-4dcc-b0a9-8d1e503e2f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:42.821193 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a6aec-eaa1-4dcc-b0a9-8d1e503e2f28 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:42.832293 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1403/2831] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:43.127868 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8fa3d-7c2f-4aa5-aebf-d2f3a8a562a5 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:43.129588 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-9ca8fa3d-7c2f-4aa5-aebf-d2f3a8a562a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:43.146476 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca8fa3d-7c2f-4aa5-aebf-d2f3a8a562a5 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:43.151238 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:43.152876 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.153160 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.153772 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] PATH_INFO: `/v3/projects/a8042f2d27c4412fb84c7c9800c41ef8` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.155090 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8042f2d27c4412fb84c7c9800c41ef8)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:43.157079 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:43.185531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:43.213111 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8042f2d27c4412fb84c7c9800c41ef8', 'request_id': 'req-9ee99307-6be3-44c1-aa89-94cbded01cfb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:43.223291 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8042f2d27c4412fb84c7c9800c41ef8', 'request_id': 'req-9ee99307-6be3-44c1-aa89-94cbded01cfb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:43.230280 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8042f2d27c4412fb84c7c9800c41ef8', 'request_id': 'req-9ee99307-6be3-44c1-aa89-94cbded01cfb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:43.241247 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] The token cache is being invalidate because project a8042f2d27c4412fb84c7c9800c41ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:50:43.241571 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:43.242199 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9ee99307-6be3-44c1-aa89-94cbded01cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:50:43.243991 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1429/2832] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:50:43 2022] DELETE /identity/v3/projects/a8042f2d27c4412fb84c7c9800c41ef8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:43.249770 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c858a-f443-4267-8305-dc676e81881f None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.250057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c858a-f443-4267-8305-dc676e81881f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.250430 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c858a-f443-4267-8305-dc676e81881f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.268761 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a53c858a-f443-4267-8305-dc676e81881f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:43.270239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a53c858a-f443-4267-8305-dc676e81881f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:43.335363 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1404/2833] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:43.347531 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1a2c8-abe0-413d-a5af-6a4f68ef5ff6 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.347863 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1a2c8-abe0-413d-a5af-6a4f68ef5ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.348070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1a2c8-abe0-413d-a5af-6a4f68ef5ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.368400 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-14a1a2c8-abe0-413d-a5af-6a4f68ef5ff6 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:43.369701 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-14a1a2c8-abe0-413d-a5af-6a4f68ef5ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:43.378435 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1430/2834] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:43.383030 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c858a-f443-4267-8305-dc676e81881f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:43.394426 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c858a-f443-4267-8305-dc676e81881f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:43.399578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1383d0c-f6e4-47ac-be47-9e834da3a9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:43.400268 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383d0c-f6e4-47ac-be47-9e834da3a9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.400549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383d0c-f6e4-47ac-be47-9e834da3a9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.400827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1383d0c-f6e4-47ac-be47-9e834da3a9b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.401573 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1383d0c-f6e4-47ac-be47-9e834da3a9b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:50:43.401882 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1383d0c-f6e4-47ac-be47-9e834da3a9b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:43.403588 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1383d0c-f6e4-47ac-be47-9e834da3a9b1 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:43.416543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1405/2835] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:50:43.421259 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1a2c8-abe0-413d-a5af-6a4f68ef5ff6 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:43.432040 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1a2c8-abe0-413d-a5af-6a4f68ef5ff6 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:43.436801 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d445dd-de9c-44a9-9525-d2a2a3cdbccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:43.437467 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d445dd-de9c-44a9-9525-d2a2a3cdbccc admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.437748 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d445dd-de9c-44a9-9525-d2a2a3cdbccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.438021 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d445dd-de9c-44a9-9525-d2a2a3cdbccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.438744 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d445dd-de9c-44a9-9525-d2a2a3cdbccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:43.440657 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d445dd-de9c-44a9-9525-d2a2a3cdbccc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:43.470395 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1431/2836] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:50:43 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:43.474674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1383d0c-f6e4-47ac-be47-9e834da3a9b1 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:43.485203 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1383d0c-f6e4-47ac-be47-9e834da3a9b1 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:43.550669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cce900-d46e-4b84-b3f3-97f5da6f11a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:43.551635 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cce900-d46e-4b84-b3f3-97f5da6f11a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.552091 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cce900-d46e-4b84-b3f3-97f5da6f11a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.552371 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cce900-d46e-4b84-b3f3-97f5da6f11a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.553126 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cce900-d46e-4b84-b3f3-97f5da6f11a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:43.555121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cce900-d46e-4b84-b3f3-97f5da6f11a2 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:43.584468 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1406/2837] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:50:43 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:50:43.586451 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d445dd-de9c-44a9-9525-d2a2a3cdbccc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:43.600839 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d445dd-de9c-44a9-9525-d2a2a3cdbccc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:43.606970 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435780e-90c8-4656-9f53-cca66b11b8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:43.607653 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435780e-90c8-4656-9f53-cca66b11b8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.608028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435780e-90c8-4656-9f53-cca66b11b8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.608296 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435780e-90c8-4656-9f53-cca66b11b8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.608945 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435780e-90c8-4656-9f53-cca66b11b8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:43.610613 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435780e-90c8-4656-9f53-cca66b11b8e8 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:43.622568 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1432/2838] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:43.627015 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cce900-d46e-4b84-b3f3-97f5da6f11a2 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:43.637515 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cce900-d46e-4b84-b3f3-97f5da6f11a2 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:43.643235 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd877fed-0f11-4fc0-b6f3-54336b998e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:43.643926 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877fed-0f11-4fc0-b6f3-54336b998e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.644189 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877fed-0f11-4fc0-b6f3-54336b998e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.644458 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd877fed-0f11-4fc0-b6f3-54336b998e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.645184 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd877fed-0f11-4fc0-b6f3-54336b998e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:43.646877 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd877fed-0f11-4fc0-b6f3-54336b998e2f admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:43.657596 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1407/2839] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:50:43.661756 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435780e-90c8-4656-9f53-cca66b11b8e8 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:43.672017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435780e-90c8-4656-9f53-cca66b11b8e8 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:43.676930 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb70d4-d0f3-4b49-b8a6-01c928a457c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:43.677812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb70d4-d0f3-4b49-b8a6-01c928a457c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.678112 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb70d4-d0f3-4b49-b8a6-01c928a457c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.678458 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb70d4-d0f3-4b49-b8a6-01c928a457c6 admin admin] PATH_INFO: `/v3/projects/cbe0655a74ee418a8e8365d149e0c55a/users/3f82499959154fdbbe97fb8f8bc79635/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.694217 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb70d4-d0f3-4b49-b8a6-01c928a457c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe0655a74ee418a8e8365d149e0c55a, user_id=3f82499959154fdbbe97fb8f8bc79635, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:43.698902 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb70d4-d0f3-4b49-b8a6-01c928a457c6 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:43.714104 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1433/2840] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:50:43 2022] PUT /identity/v3/projects/cbe0655a74ee418a8e8365d149e0c55a/users/3f82499959154fdbbe97fb8f8bc79635/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:50:43.725285 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8be0a7-99d8-4801-ac4b-19827a9d0fb1 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.725571 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8be0a7-99d8-4801-ac4b-19827a9d0fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.725851 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8be0a7-99d8-4801-ac4b-19827a9d0fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.756339 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9c8be0a7-99d8-4801-ac4b-19827a9d0fb1 None None] MFA Rules not processed for user `3f82499959154fdbbe97fb8f8bc79635`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:43.757650 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9c8be0a7-99d8-4801-ac4b-19827a9d0fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:43.804659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:43.833582 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1408/2841] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:50:43 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:43.845321 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb70d4-d0f3-4b49-b8a6-01c928a457c6 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:43.847123 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-dddb70d4-d0f3-4b49-b8a6-01c928a457c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:43.922198 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb70d4-d0f3-4b49-b8a6-01c928a457c6 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:43.925884 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56245cd-339f-4801-bd22-355b48b92253 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0edbf66359f1426999f4c28a83f2bdca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:43.926565 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56245cd-339f-4801-bd22-355b48b92253 service glance] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:43.926849 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56245cd-339f-4801-bd22-355b48b92253 service glance] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:43.927126 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56245cd-339f-4801-bd22-355b48b92253 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:43.937110 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56245cd-339f-4801-bd22-355b48b92253 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:43.938888 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56245cd-339f-4801-bd22-355b48b92253 service glance] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:43.948700 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1434/2842] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:43 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:50:53.830574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=9 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:53.944664 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:DELETE=7,keystone:SELECT=68,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:50:56.507638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc465f87-9fd1-4bba-8b4d-ff6bda5730d7 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:56.508239 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc465f87-9fd1-4bba-8b4d-ff6bda5730d7 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:56.508356 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc465f87-9fd1-4bba-8b4d-ff6bda5730d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:56.526517 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-fc465f87-9fd1-4bba-8b4d-ff6bda5730d7 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:56.527744 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-fc465f87-9fd1-4bba-8b4d-ff6bda5730d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:56.604888 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1409/2843] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:56.634377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56245cd-339f-4801-bd22-355b48b92253 service glance] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:56.636011 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-d56245cd-339f-4801-bd22-355b48b92253 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:56.722309 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56245cd-339f-4801-bd22-355b48b92253 service glance] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:56.728083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b401304-ea23-4f61-87e9-56742ad6742a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:56.728738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b401304-ea23-4f61-87e9-56742ad6742a service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:56.729022 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b401304-ea23-4f61-87e9-56742ad6742a service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:56.729294 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b401304-ea23-4f61-87e9-56742ad6742a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:56.738392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b401304-ea23-4f61-87e9-56742ad6742a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:56.739997 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b401304-ea23-4f61-87e9-56742ad6742a service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:56.750024 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1435/2844] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:50:59.553425 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d13e4-c4ca-47a0-a666-a2e7c5d043f4 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:59.554004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d13e4-c4ca-47a0-a666-a2e7c5d043f4 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:59.554004 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d13e4-c4ca-47a0-a666-a2e7c5d043f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:59.574245 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-837d13e4-c4ca-47a0-a666-a2e7c5d043f4 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:50:59.575481 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-837d13e4-c4ca-47a0-a666-a2e7c5d043f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:59.584802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1410/2845] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:50:59.608973 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b401304-ea23-4f61-87e9-56742ad6742a service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:50:59.610496 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-1b401304-ea23-4f61-87e9-56742ad6742a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:50:59.626974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b401304-ea23-4f61-87e9-56742ad6742a service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:50:59.634259 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a8633-e38e-48d9-a474-454033b6b5ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:50:59.636056 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a8633-e38e-48d9-a474-454033b6b5ab service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:50:59.636335 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a8633-e38e-48d9-a474-454033b6b5ab service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:50:59.636608 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a8633-e38e-48d9-a474-454033b6b5ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:50:59.645615 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a8633-e38e-48d9-a474-454033b6b5ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:50:59.647185 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a8633-e38e-48d9-a474-454033b6b5ab service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:50:59.658230 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1436/2846] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:02.829611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4303-6647-4417-a7dc-5e8459123a48 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:02.830113 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4303-6647-4417-a7dc-5e8459123a48 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:02.830319 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4303-6647-4417-a7dc-5e8459123a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:02.862441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-904b4303-6647-4417-a7dc-5e8459123a48 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:02.864501 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-904b4303-6647-4417-a7dc-5e8459123a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:02.877121 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1411/2847] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:02.906112 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a8633-e38e-48d9-a474-454033b6b5ab service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:02.917769 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a8633-e38e-48d9-a474-454033b6b5ab service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:02.923493 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c892c6-88c1-48e8-b6e8-777b1a391cab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:02.924142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c892c6-88c1-48e8-b6e8-777b1a391cab service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:02.924425 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c892c6-88c1-48e8-b6e8-777b1a391cab service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:02.924697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c892c6-88c1-48e8-b6e8-777b1a391cab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:02.933766 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c892c6-88c1-48e8-b6e8-777b1a391cab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:02.935474 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c892c6-88c1-48e8-b6e8-777b1a391cab service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:02.945573 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1437/2848] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:05.886281 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c657a-c771-4841-99d2-dffd12c7d29c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:05.886818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c657a-c771-4841-99d2-dffd12c7d29c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:05.886818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c657a-c771-4841-99d2-dffd12c7d29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:05.906049 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-557c657a-c771-4841-99d2-dffd12c7d29c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:05.907267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-557c657a-c771-4841-99d2-dffd12c7d29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:05.915264 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1412/2849] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:05.938407 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c892c6-88c1-48e8-b6e8-777b1a391cab service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:05.950171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c892c6-88c1-48e8-b6e8-777b1a391cab service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:05.956660 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d09a7-c6ff-4fd4-977f-b7ec90b560d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:05.957301 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d09a7-c6ff-4fd4-977f-b7ec90b560d7 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:05.957582 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d09a7-c6ff-4fd4-977f-b7ec90b560d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:05.957855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d09a7-c6ff-4fd4-977f-b7ec90b560d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:05.967311 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d09a7-c6ff-4fd4-977f-b7ec90b560d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:05.968893 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d09a7-c6ff-4fd4-977f-b7ec90b560d7 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:05.978813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1438/2850] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:09.057643 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ae498-316b-4dcd-8f3a-9e63f7ed1906 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:09.058299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ae498-316b-4dcd-8f3a-9e63f7ed1906 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:09.058299 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ae498-316b-4dcd-8f3a-9e63f7ed1906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:09.080629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9b4ae498-316b-4dcd-8f3a-9e63f7ed1906 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:09.080629 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9b4ae498-316b-4dcd-8f3a-9e63f7ed1906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:09.089818 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1413/2851] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:09.113995 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d09a7-c6ff-4fd4-977f-b7ec90b560d7 service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:09.129882 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d09a7-c6ff-4fd4-977f-b7ec90b560d7 service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:09.135942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ef4e7-0b0e-4e8e-bf9e-c6bbf8af1a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:09.136859 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ef4e7-0b0e-4e8e-bf9e-c6bbf8af1a12 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:09.137206 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ef4e7-0b0e-4e8e-bf9e-c6bbf8af1a12 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:09.137489 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ef4e7-0b0e-4e8e-bf9e-c6bbf8af1a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:09.151508 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ef4e7-0b0e-4e8e-bf9e-c6bbf8af1a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:09.153100 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ef4e7-0b0e-4e8e-bf9e-c6bbf8af1a12 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:09.169570 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1439/2852] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 14:51:09.734933 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ae498-316b-4dcd-8f3a-9e63f7ed1906 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:09.744772 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ae498-316b-4dcd-8f3a-9e63f7ed1906 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:09.749360 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:09.750267 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:09.750549 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:09.750820 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] PATH_INFO: `/v3/users/3f82499959154fdbbe97fb8f8bc79635` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:09.752029 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f82499959154fdbbe97fb8f8bc79635)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:09.753944 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:09.803373 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f82499959154fdbbe97fb8f8bc79635'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:09.804039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f82499959154fdbbe97fb8f8bc79635'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:09.804653 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f82499959154fdbbe97fb8f8bc79635'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:09.816708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f82499959154fdbbe97fb8f8bc79635'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:09.823705 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f82499959154fdbbe97fb8f8bc79635'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:09.839412 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1414/2853] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:51:09 2022] DELETE /identity/v3/users/3f82499959154fdbbe97fb8f8bc79635 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:51:09.844590 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a19b4-d6bb-48b7-970e-e1b97e497650 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:09.844817 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a19b4-d6bb-48b7-970e-e1b97e497650 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:09.845086 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a19b4-d6bb-48b7-970e-e1b97e497650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:09.863858 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-e63a19b4-d6bb-48b7-970e-e1b97e497650 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:09.865064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e63a19b4-d6bb-48b7-970e-e1b97e497650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:09.925514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1440/2854] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:09.935157 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:09.936611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:09.989734 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:09.996257 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f9d14-da5b-472b-ad14-12a20c0f8d68 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:10.000963 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800afc5e-68c2-4e92-97cf-289afef72784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:10.001631 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800afc5e-68c2-4e92-97cf-289afef72784 service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.001913 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800afc5e-68c2-4e92-97cf-289afef72784 service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.002229 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800afc5e-68c2-4e92-97cf-289afef72784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.012092 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800afc5e-68c2-4e92-97cf-289afef72784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:10.013535 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800afc5e-68c2-4e92-97cf-289afef72784 service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:10.026708 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1415/2855] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:10.310462 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a19b4-d6bb-48b7-970e-e1b97e497650 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:10.312026 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-e63a19b4-d6bb-48b7-970e-e1b97e497650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:10.324988 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a19b4-d6bb-48b7-970e-e1b97e497650 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:10.331409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:10.332695 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.333067 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.333433 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] PATH_INFO: `/v3/projects/cbe0655a74ee418a8e8365d149e0c55a` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.334738 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe0655a74ee418a8e8365d149e0c55a)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:10.336984 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:10.372356 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:10.391364 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe0655a74ee418a8e8365d149e0c55a', 'request_id': 'req-9052afc4-6630-4830-8672-12ef1edf15eb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:10.400369 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe0655a74ee418a8e8365d149e0c55a', 'request_id': 'req-9052afc4-6630-4830-8672-12ef1edf15eb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:10.407711 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe0655a74ee418a8e8365d149e0c55a', 'request_id': 'req-9052afc4-6630-4830-8672-12ef1edf15eb'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:10.418589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] The token cache is being invalidate because project cbe0655a74ee418a8e8365d149e0c55a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:51:10.418880 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:10.419605 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-9052afc4-6630-4830-8672-12ef1edf15eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:10.421214 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1441/2856] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:51:10 2022] DELETE /identity/v3/projects/cbe0655a74ee418a8e8365d149e0c55a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:51:10.429669 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a173b6-161a-476d-8e69-dab7acffc3ec None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.430238 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a173b6-161a-476d-8e69-dab7acffc3ec None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.430349 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a173b6-161a-476d-8e69-dab7acffc3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.448802 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-f9a173b6-161a-476d-8e69-dab7acffc3ec None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:10.450011 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-f9a173b6-161a-476d-8e69-dab7acffc3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:10.511659 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1416/2857] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:10.519749 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec830cca-a081-4d5e-bc38-e1e3562a9fae None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.520045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec830cca-a081-4d5e-bc38-e1e3562a9fae None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.520328 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec830cca-a081-4d5e-bc38-e1e3562a9fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.541609 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-ec830cca-a081-4d5e-bc38-e1e3562a9fae None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:10.542913 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-ec830cca-a081-4d5e-bc38-e1e3562a9fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:10.552005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1442/2858] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:10.556480 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a173b6-161a-476d-8e69-dab7acffc3ec None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:10.567387 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a173b6-161a-476d-8e69-dab7acffc3ec None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:10.571924 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f716f0-c140-46a9-a8d7-d8f2ffac0efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:10.572593 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f716f0-c140-46a9-a8d7-d8f2ffac0efb admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.572880 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f716f0-c140-46a9-a8d7-d8f2ffac0efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.573160 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f716f0-c140-46a9-a8d7-d8f2ffac0efb admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.573896 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f716f0-c140-46a9-a8d7-d8f2ffac0efb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:51:10.574241 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f716f0-c140-46a9-a8d7-d8f2ffac0efb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:10.576497 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f716f0-c140-46a9-a8d7-d8f2ffac0efb admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:10.589072 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1417/2859] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 14:51:10.593398 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec830cca-a081-4d5e-bc38-e1e3562a9fae None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:10.602996 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec830cca-a081-4d5e-bc38-e1e3562a9fae None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:10.608028 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f01a3f-fe34-4359-86f4-d0e327b19e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:10.608735 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f01a3f-fe34-4359-86f4-d0e327b19e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.609151 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f01a3f-fe34-4359-86f4-d0e327b19e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.609523 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f01a3f-fe34-4359-86f4-d0e327b19e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.610390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f01a3f-fe34-4359-86f4-d0e327b19e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:10.612430 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f01a3f-fe34-4359-86f4-d0e327b19e84 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:10.644517 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1443/2860] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:51:10 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:51:10.645682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f716f0-c140-46a9-a8d7-d8f2ffac0efb admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:10.655737 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f716f0-c140-46a9-a8d7-d8f2ffac0efb admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:10.713541 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0d388-12d3-4165-b3d2-92c2b6a313c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:10.714326 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0d388-12d3-4165-b3d2-92c2b6a313c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.714611 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0d388-12d3-4165-b3d2-92c2b6a313c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.714887 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a0d388-12d3-4165-b3d2-92c2b6a313c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.715623 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0d388-12d3-4165-b3d2-92c2b6a313c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:10.717586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a0d388-12d3-4165-b3d2-92c2b6a313c5 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:10.738985 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1418/2861] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:51:10 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:51:10.744246 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f01a3f-fe34-4359-86f4-d0e327b19e84 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:10.755901 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f01a3f-fe34-4359-86f4-d0e327b19e84 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:10.763654 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f2f3a-d78b-4870-9da4-b7b7695b25b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:10.764255 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f2f3a-d78b-4870-9da4-b7b7695b25b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.764538 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f2f3a-d78b-4870-9da4-b7b7695b25b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.764813 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f2f3a-d78b-4870-9da4-b7b7695b25b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.765543 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f2f3a-d78b-4870-9da4-b7b7695b25b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:10.767189 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26f2f3a-d78b-4870-9da4-b7b7695b25b4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:10.779089 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1444/2862] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:51:10.782876 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0d388-12d3-4165-b3d2-92c2b6a313c5 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:10.793028 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a0d388-12d3-4165-b3d2-92c2b6a313c5 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:10.797747 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99131e8d-d3de-4f47-89e4-c20f33923f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:10.798438 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99131e8d-d3de-4f47-89e4-c20f33923f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.798722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99131e8d-d3de-4f47-89e4-c20f33923f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.798995 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99131e8d-d3de-4f47-89e4-c20f33923f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.799715 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99131e8d-d3de-4f47-89e4-c20f33923f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:10.801309 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99131e8d-d3de-4f47-89e4-c20f33923f23 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:10.812779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1419/2863] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:51:10.816934 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f2f3a-d78b-4870-9da4-b7b7695b25b4 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:10.831436 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f2f3a-d78b-4870-9da4-b7b7695b25b4 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:10.836156 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b9dc-e2b7-43c3-aee3-b053f72db026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:10.837044 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b9dc-e2b7-43c3-aee3-b053f72db026 admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.837326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b9dc-e2b7-43c3-aee3-b053f72db026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.837603 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5b9dc-e2b7-43c3-aee3-b053f72db026 admin admin] PATH_INFO: `/v3/projects/4f195930cdd84849ab63945fd71d6d67/users/4a472b28b8bb4cbd85d8f373cc257bef/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.853390 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5b9dc-e2b7-43c3-aee3-b053f72db026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f195930cdd84849ab63945fd71d6d67, user_id=4a472b28b8bb4cbd85d8f373cc257bef, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:10.856129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5b9dc-e2b7-43c3-aee3-b053f72db026 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:10.871361 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1445/2864] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:51:10 2022] PUT /identity/v3/projects/4f195930cdd84849ab63945fd71d6d67/users/4a472b28b8bb4cbd85d8f373cc257bef/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:51:10.882294 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774945-b382-42a8-92c9-d291cf324a8b None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:10.882587 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774945-b382-42a8-92c9-d291cf324a8b None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:10.882866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b774945-b382-42a8-92c9-d291cf324a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:10.911369 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9b774945-b382-42a8-92c9-d291cf324a8b None None] MFA Rules not processed for user `4a472b28b8bb4cbd85d8f373cc257bef`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:10.914034 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9b774945-b382-42a8-92c9-d291cf324a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:10.959413 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:10.981240 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1420/2865] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:51:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:10.993133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b9dc-e2b7-43c3-aee3-b053f72db026 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:10.995938 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fda5b9dc-e2b7-43c3-aee3-b053f72db026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:11.055225 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5b9dc-e2b7-43c3-aee3-b053f72db026 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:11.059093 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91369be-69c0-4f3f-829c-1ef3762468e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:11.060423 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91369be-69c0-4f3f-829c-1ef3762468e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:11.060759 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91369be-69c0-4f3f-829c-1ef3762468e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:11.061060 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91369be-69c0-4f3f-829c-1ef3762468e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:11.070722 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91369be-69c0-4f3f-829c-1ef3762468e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:11.071923 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91369be-69c0-4f3f-829c-1ef3762468e7 service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:11.081551 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1446/2866] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:12.231046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459e31c-f6d0-438e-8c6a-700f36702b9c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:12.231600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459e31c-f6d0-438e-8c6a-700f36702b9c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:12.231600 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459e31c-f6d0-438e-8c6a-700f36702b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:12.251085 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-9459e31c-f6d0-438e-8c6a-700f36702b9c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:12.252345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9459e31c-f6d0-438e-8c6a-700f36702b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:12.320095 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1421/2867] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:12.343656 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91369be-69c0-4f3f-829c-1ef3762468e7 service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:12.345192 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-c91369be-69c0-4f3f-829c-1ef3762468e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:12.402574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:12.426232 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91369be-69c0-4f3f-829c-1ef3762468e7 service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:12.431796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab8266-f103-4cb7-b884-76fafd6be8ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:12.432450 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8266-f103-4cb7-b884-76fafd6be8ae service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:12.432855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8266-f103-4cb7-b884-76fafd6be8ae service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:12.433003 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8266-f103-4cb7-b884-76fafd6be8ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:12.454148 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab8266-f103-4cb7-b884-76fafd6be8ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:12.455796 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab8266-f103-4cb7-b884-76fafd6be8ae service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:12.466589 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1447/2868] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:22.312336 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=34 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:22.462447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=9 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:22.684620 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459e31c-f6d0-438e-8c6a-700f36702b9c None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:22.686039 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-9459e31c-f6d0-438e-8c6a-700f36702b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:22.765449 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459e31c-f6d0-438e-8c6a-700f36702b9c None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:22.770561 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4de124-d6c1-401a-8e9a-bccc8b8e28fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582296b1e43f4d12ab99eec9283b0d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:22.771222 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de124-d6c1-401a-8e9a-bccc8b8e28fc service placement] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:22.771505 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de124-d6c1-401a-8e9a-bccc8b8e28fc service placement] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:22.771779 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4de124-d6c1-401a-8e9a-bccc8b8e28fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:22.773638 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ea4de124-d6c1-401a-8e9a-bccc8b8e28fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:22.787231 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4de124-d6c1-401a-8e9a-bccc8b8e28fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:22.788827 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4de124-d6c1-401a-8e9a-bccc8b8e28fc service placement] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:22.800275 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1422/2869] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:27.487899 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41447-32f7-4f89-8e8d-ec40077805ea None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:27.488413 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41447-32f7-4f89-8e8d-ec40077805ea None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:27.488544 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d41447-32f7-4f89-8e8d-ec40077805ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:27.515005 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-99d41447-32f7-4f89-8e8d-ec40077805ea None None] MFA Rules not processed for user `8d0c587d01ac44b79972e49a5f0aeeee`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:27.516249 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-99d41447-32f7-4f89-8e8d-ec40077805ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:27.577017 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1448/2870] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:51:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:32.795514 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=32 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:37.570574 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=25 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:40.977380 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4de124-d6c1-401a-8e9a-bccc8b8e28fc service placement] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:40.988494 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4de124-d6c1-401a-8e9a-bccc8b8e28fc service placement] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:40.994522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:40.994719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:40.994945 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:40.995218 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] PATH_INFO: `/v3/users/4a472b28b8bb4cbd85d8f373cc257bef` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:40.998149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a472b28b8bb4cbd85d8f373cc257bef)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:41.000084 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:41.049007 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a472b28b8bb4cbd85d8f373cc257bef'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:41.049749 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a472b28b8bb4cbd85d8f373cc257bef'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:41.050401 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a472b28b8bb4cbd85d8f373cc257bef'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:41.063455 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a472b28b8bb4cbd85d8f373cc257bef'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:41.071533 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a472b28b8bb4cbd85d8f373cc257bef'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:41.085812 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1423/2871] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:51:40 2022] DELETE /identity/v3/users/4a472b28b8bb4cbd85d8f373cc257bef => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:51:41.090494 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998555c-c3fe-45ed-9f2a-79908a3a9e12 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:41.091019 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998555c-c3fe-45ed-9f2a-79908a3a9e12 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:41.091133 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998555c-c3fe-45ed-9f2a-79908a3a9e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:41.110518 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-0998555c-c3fe-45ed-9f2a-79908a3a9e12 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:41.111662 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0998555c-c3fe-45ed-9f2a-79908a3a9e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:41.184492 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1449/2872] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:51:41.197114 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:41.198486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:41.266578 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f751e3-b3d1-463c-bd1a-1a5fa0d05334 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:41.270462 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b98de-707c-48b7-a616-f4e13bdd00be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:41.271117 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b98de-707c-48b7-a616-f4e13bdd00be service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:41.271404 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b98de-707c-48b7-a616-f4e13bdd00be service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:41.271682 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b98de-707c-48b7-a616-f4e13bdd00be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:41.282580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b98de-707c-48b7-a616-f4e13bdd00be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:41.284041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b98de-707c-48b7-a616-f4e13bdd00be service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:41.294885 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1424/2873] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:41.567617 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998555c-c3fe-45ed-9f2a-79908a3a9e12 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:41.569116 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-0998555c-c3fe-45ed-9f2a-79908a3a9e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:41.582975 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998555c-c3fe-45ed-9f2a-79908a3a9e12 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:41.588323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:41.589274 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:41.589498 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:41.589773 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] PATH_INFO: `/v3/projects/4f195930cdd84849ab63945fd71d6d67` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:41.591851 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f195930cdd84849ab63945fd71d6d67)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:41.594262 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:41.643134 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f195930cdd84849ab63945fd71d6d67', 'request_id': 'req-813c5540-c6bd-41ac-8167-60be184554d4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:41.650974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f195930cdd84849ab63945fd71d6d67', 'request_id': 'req-813c5540-c6bd-41ac-8167-60be184554d4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:41.659339 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f195930cdd84849ab63945fd71d6d67', 'request_id': 'req-813c5540-c6bd-41ac-8167-60be184554d4'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:41.670939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] The token cache is being invalidate because project 4f195930cdd84849ab63945fd71d6d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:51:41.671236 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:41.671939 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-813c5540-c6bd-41ac-8167-60be184554d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:41.673635 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1450/2874] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:51:41 2022] DELETE /identity/v3/projects/4f195930cdd84849ab63945fd71d6d67 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:51:41.678834 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db5bc4-02ad-4c8c-8690-8cf61df3c19f None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:41.679366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db5bc4-02ad-4c8c-8690-8cf61df3c19f None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:41.679651 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07db5bc4-02ad-4c8c-8690-8cf61df3c19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:41.697916 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-07db5bc4-02ad-4c8c-8690-8cf61df3c19f None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:41.699179 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-07db5bc4-02ad-4c8c-8690-8cf61df3c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:41.763796 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1425/2875] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:41.771798 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12a65c-0179-4879-bea7-0a195cee7c2c None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:41.772083 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12a65c-0179-4879-bea7-0a195cee7c2c None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:41.772358 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12a65c-0179-4879-bea7-0a195cee7c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:41.792054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-fc12a65c-0179-4879-bea7-0a195cee7c2c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:41.793360 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-fc12a65c-0179-4879-bea7-0a195cee7c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:41.801776 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1451/2876] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:41.807311 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db5bc4-02ad-4c8c-8690-8cf61df3c19f None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:41.819534 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07db5bc4-02ad-4c8c-8690-8cf61df3c19f None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:41.825586 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342381d-0ba3-4363-a2f0-7b509b470b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:41.826314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342381d-0ba3-4363-a2f0-7b509b470b92 admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:41.827469 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342381d-0ba3-4363-a2f0-7b509b470b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:41.827763 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342381d-0ba3-4363-a2f0-7b509b470b92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:41.828509 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342381d-0ba3-4363-a2f0-7b509b470b92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80476) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 14:51:41.828815 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342381d-0ba3-4363-a2f0-7b509b470b92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:41.830551 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342381d-0ba3-4363-a2f0-7b509b470b92 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:41.845361 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1426/2877] 10.222.0.79 () {58 vars in 1152 bytes} [Wed May 25 14:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 14:51:41.847452 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12a65c-0179-4879-bea7-0a195cee7c2c None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:41.857747 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12a65c-0179-4879-bea7-0a195cee7c2c None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:41.862457 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9c637-8213-4c31-bfe9-8f39f0da17f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:41.863118 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9c637-8213-4c31-bfe9-8f39f0da17f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:41.863399 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9c637-8213-4c31-bfe9-8f39f0da17f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:41.863671 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9c637-8213-4c31-bfe9-8f39f0da17f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:41.864354 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9c637-8213-4c31-bfe9-8f39f0da17f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:41.866314 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9c637-8213-4c31-bfe9-8f39f0da17f3 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:41.895392 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1452/2878] 10.222.0.79 () {60 vars in 1152 bytes} [Wed May 25 14:51:41 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 14:51:41.897771 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342381d-0ba3-4363-a2f0-7b509b470b92 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:41.902976 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:41.909866 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342381d-0ba3-4363-a2f0-7b509b470b92 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:41.969081 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7687e-bce5-4806-8464-403c1773ae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:41.969757 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7687e-bce5-4806-8464-403c1773ae48 admin admin] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:41.970041 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7687e-bce5-4806-8464-403c1773ae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:41.970353 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7687e-bce5-4806-8464-403c1773ae48 admin admin] PATH_INFO: `/v3/users` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:41.971046 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7687e-bce5-4806-8464-403c1773ae48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:41.973017 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc7687e-bce5-4806-8464-403c1773ae48 admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:41.995274 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1427/2879] 10.222.0.79 () {60 vars in 1143 bytes} [Wed May 25 14:51:41 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 14:51:41.999318 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9c637-8213-4c31-bfe9-8f39f0da17f3 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:42.010114 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9c637-8213-4c31-bfe9-8f39f0da17f3 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:42.014806 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e96784-4b33-4fef-9af4-69b4ebfb7885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:42.015506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e96784-4b33-4fef-9af4-69b4ebfb7885 admin admin] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:42.015791 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e96784-4b33-4fef-9af4-69b4ebfb7885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:42.016070 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e96784-4b33-4fef-9af4-69b4ebfb7885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:42.016795 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e96784-4b33-4fef-9af4-69b4ebfb7885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:42.018456 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e96784-4b33-4fef-9af4-69b4ebfb7885 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:42.029802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1453/2880] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:51:42.033823 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7687e-bce5-4806-8464-403c1773ae48 admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:42.044717 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc7687e-bce5-4806-8464-403c1773ae48 admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:42.049345 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cca2eb-543f-492a-bdc7-1d3112ad32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:42.050142 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cca2eb-543f-492a-bdc7-1d3112ad32bd admin admin] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:42.050452 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cca2eb-543f-492a-bdc7-1d3112ad32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:42.050754 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cca2eb-543f-492a-bdc7-1d3112ad32bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:42.051484 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cca2eb-543f-492a-bdc7-1d3112ad32bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:42.053431 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cca2eb-543f-492a-bdc7-1d3112ad32bd admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:42.064424 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1428/2881] 10.222.0.79 () {58 vars in 1121 bytes} [Wed May 25 14:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 14:51:42.068562 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e96784-4b33-4fef-9af4-69b4ebfb7885 admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:42.078797 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e96784-4b33-4fef-9af4-69b4ebfb7885 admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:42.083608 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb4e31-b9a3-4325-88aa-4a854891e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:42.084487 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb4e31-b9a3-4325-88aa-4a854891e51a admin admin] REQUEST_METHOD: `PUT` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:42.084771 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb4e31-b9a3-4325-88aa-4a854891e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:42.085049 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb4e31-b9a3-4325-88aa-4a854891e51a admin admin] PATH_INFO: `/v3/projects/060887fb0a984f3f9599cc1a252a9688/users/af523cd3b73d432f9088f2f3f90115d1/roles/faabf98abc6d4899b452e792928050ca` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:42.102472 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb4e31-b9a3-4325-88aa-4a854891e51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=060887fb0a984f3f9599cc1a252a9688, user_id=af523cd3b73d432f9088f2f3f90115d1, role_id=faabf98abc6d4899b452e792928050ca)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:42.105158 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb4e31-b9a3-4325-88aa-4a854891e51a admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:42.119447 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1454/2882] 10.222.0.79 () {60 vars in 1482 bytes} [Wed May 25 14:51:42 2022] PUT /identity/v3/projects/060887fb0a984f3f9599cc1a252a9688/users/af523cd3b73d432f9088f2f3f90115d1/roles/faabf98abc6d4899b452e792928050ca => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:51:42.130557 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269222b7-6ec0-443b-88aa-fa40698e018d None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:42.130841 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269222b7-6ec0-443b-88aa-fa40698e018d None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:42.131115 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269222b7-6ec0-443b-88aa-fa40698e018d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:42.159980 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-269222b7-6ec0-443b-88aa-fa40698e018d None None] MFA Rules not processed for user `af523cd3b73d432f9088f2f3f90115d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:42.161226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-269222b7-6ec0-443b-88aa-fa40698e018d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:42.228950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1429/2883] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:51:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:42.241103 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb4e31-b9a3-4325-88aa-4a854891e51a admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:42.243119 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-33fb4e31-b9a3-4325-88aa-4a854891e51a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:42.271786 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:42.315665 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb4e31-b9a3-4325-88aa-4a854891e51a admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:42.319323 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092407c-753c-4608-add3-d2c2a87ff81d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eacbb2c50c2c464db93b6cff7a10f7c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:42.319966 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092407c-753c-4608-add3-d2c2a87ff81d service cinder] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:42.320243 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092407c-753c-4608-add3-d2c2a87ff81d service cinder] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:42.320518 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092407c-753c-4608-add3-d2c2a87ff81d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:42.330125 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092407c-753c-4608-add3-d2c2a87ff81d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:42.331753 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092407c-753c-4608-add3-d2c2a87ff81d service cinder] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:42.341546 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1455/2884] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:42.554574 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688694-1c85-4220-bd04-23143c783b5c None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:42.554864 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688694-1c85-4220-bd04-23143c783b5c None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:42.555136 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688694-1c85-4220-bd04-23143c783b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:42.576639 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-59688694-1c85-4220-bd04-23143c783b5c None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:42.578284 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-59688694-1c85-4220-bd04-23143c783b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:42.642690 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1430/2885] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:42.662799 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092407c-753c-4608-add3-d2c2a87ff81d service cinder] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:42.664289 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6092407c-753c-4608-add3-d2c2a87ff81d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:42.785235 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092407c-753c-4608-add3-d2c2a87ff81d service cinder] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:42.791045 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd0b4-75e3-4003-b008-36e47228070b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:42.791844 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd0b4-75e3-4003-b008-36e47228070b service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:42.792130 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd0b4-75e3-4003-b008-36e47228070b service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:42.792405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bd0b4-75e3-4003-b008-36e47228070b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:42.802723 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bd0b4-75e3-4003-b008-36e47228070b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:42.806304 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bd0b4-75e3-4003-b008-36e47228070b service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:42.814750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1456/2886] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:45.932918 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbebb7f-78e1-4564-97b1-80b9ef525359 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:45.933510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbebb7f-78e1-4564-97b1-80b9ef525359 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:45.933510 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbebb7f-78e1-4564-97b1-80b9ef525359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:45.952283 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-abbebb7f-78e1-4564-97b1-80b9ef525359 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:45.953511 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-abbebb7f-78e1-4564-97b1-80b9ef525359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:45.962156 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1431/2887] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:51:45.982251 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd0b4-75e3-4003-b008-36e47228070b service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:45.983689 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f84bd0b4-75e3-4003-b008-36e47228070b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:45.998763 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bd0b4-75e3-4003-b008-36e47228070b service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:46.004326 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee69a-1ab2-4421-8ed9-46563853239d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:46.004974 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee69a-1ab2-4421-8ed9-46563853239d service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:46.005256 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee69a-1ab2-4421-8ed9-46563853239d service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:46.005533 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34ee69a-1ab2-4421-8ed9-46563853239d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:46.015012 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ee69a-1ab2-4421-8ed9-46563853239d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:46.016616 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34ee69a-1ab2-4421-8ed9-46563853239d service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:46.026972 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1457/2888] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:48.908186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e586b9-1d79-4733-8740-b076f6f6a593 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:48.908804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e586b9-1d79-4733-8740-b076f6f6a593 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:48.909276 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e586b9-1d79-4733-8740-b076f6f6a593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:48.921681 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:48.934996 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-09e586b9-1d79-4733-8740-b076f6f6a593 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:48.936496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-09e586b9-1d79-4733-8740-b076f6f6a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:48.944984 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1432/2889] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:51:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:48.968802 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee69a-1ab2-4421-8ed9-46563853239d service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:48.981016 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34ee69a-1ab2-4421-8ed9-46563853239d service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:48.987405 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695e43e-94a1-4180-9ce7-6f6d569e48fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:48.988064 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695e43e-94a1-4180-9ce7-6f6d569e48fc service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:48.988374 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695e43e-94a1-4180-9ce7-6f6d569e48fc service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:48.988697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695e43e-94a1-4180-9ce7-6f6d569e48fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:48.997716 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695e43e-94a1-4180-9ce7-6f6d569e48fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:48.999627 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695e43e-94a1-4180-9ce7-6f6d569e48fc service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:49.010004 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1458/2890] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:52.071095 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ad9f-65ae-432f-9185-eea20d8dfa47 None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:52.071648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ad9f-65ae-432f-9185-eea20d8dfa47 None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:52.071648 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648ad9f-65ae-432f-9185-eea20d8dfa47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:52.090454 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-a648ad9f-65ae-432f-9185-eea20d8dfa47 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:52.092221 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-a648ad9f-65ae-432f-9185-eea20d8dfa47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:52.100226 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1433/2891] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 14:51:52.124417 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695e43e-94a1-4180-9ce7-6f6d569e48fc service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:52.136293 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695e43e-94a1-4180-9ce7-6f6d569e48fc service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:52.142506 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061b45a-ab80-4fb0-aaf5-73e6120da91a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:52.143153 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b45a-ab80-4fb0-aaf5-73e6120da91a service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:52.143438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b45a-ab80-4fb0-aaf5-73e6120da91a service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:52.143717 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061b45a-ab80-4fb0-aaf5-73e6120da91a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:52.154428 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061b45a-ab80-4fb0-aaf5-73e6120da91a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:52.156041 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061b45a-ab80-4fb0-aaf5-73e6120da91a service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:52.166327 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1459/2892] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:52.435719 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648ad9f-65ae-432f-9185-eea20d8dfa47 None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:52.448366 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648ad9f-65ae-432f-9185-eea20d8dfa47 None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:52.453804 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:52.454735 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:52.455021 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:52.455318 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] PATH_INFO: `/v3/users/af523cd3b73d432f9088f2f3f90115d1` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:52.456564 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=af523cd3b73d432f9088f2f3f90115d1)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:52.458543 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:52.508890 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af523cd3b73d432f9088f2f3f90115d1'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:52.509483 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af523cd3b73d432f9088f2f3f90115d1'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:52.510111 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af523cd3b73d432f9088f2f3f90115d1'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:52.524314 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af523cd3b73d432f9088f2f3f90115d1'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:52.531389 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af523cd3b73d432f9088f2f3f90115d1'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:52.545722 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1434/2893] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:51:52 2022] DELETE /identity/v3/users/af523cd3b73d432f9088f2f3f90115d1 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:51:52.550409 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e79f7-680f-4e9c-b099-90a2ca232a50 None None] REQUEST_METHOD: `POST` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:52.550694 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e79f7-680f-4e9c-b099-90a2ca232a50 None None] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:52.550994 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e79f7-680f-4e9c-b099-90a2ca232a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:52.569875 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.auth.core [None req-f25e79f7-680f-4e9c-b099-90a2ca232a50 None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:52.571171 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f25e79f7-680f-4e9c-b099-90a2ca232a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:52.634263 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1460/2894] 10.222.0.79 () {58 vars in 957 bytes} [Wed May 25 14:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:52.644539 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:52.646766 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:52.716814 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8604ecb9-1da7-446d-89c6-ed64e1f1e0ed admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:52.720496 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148b209-1ff0-480a-9f30-83c3ac1ac5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e4270ab375e04196ad17f121f4175915', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:52.721140 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148b209-1ff0-480a-9f30-83c3ac1ac5ac service neutron] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:52.721446 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148b209-1ff0-480a-9f30-83c3ac1ac5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:52.721720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148b209-1ff0-480a-9f30-83c3ac1ac5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:52.731603 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148b209-1ff0-480a-9f30-83c3ac1ac5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:52.733071 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148b209-1ff0-480a-9f30-83c3ac1ac5ac service neutron] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:52.743248 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1435/2895] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:51:53.032604 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e79f7-680f-4e9c-b099-90a2ca232a50 None None] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:53.034472 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-f25e79f7-680f-4e9c-b099-90a2ca232a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:53.050142 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e79f7-680f-4e9c-b099-90a2ca232a50 None None] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:53.056174 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:53.057054 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:53.057334 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:53.057611 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] PATH_INFO: `/v3/projects/060887fb0a984f3f9599cc1a252a9688` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:53.060942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=060887fb0a984f3f9599cc1a252a9688)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:53.063481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:53.066673 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=100 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:51:53.115127 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '060887fb0a984f3f9599cc1a252a9688', 'request_id': 'req-6a676204-a077-4e3f-beab-b37514b703bc'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:53.124645 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '060887fb0a984f3f9599cc1a252a9688', 'request_id': 'req-6a676204-a077-4e3f-beab-b37514b703bc'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:53.131432 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '060887fb0a984f3f9599cc1a252a9688', 'request_id': 'req-6a676204-a077-4e3f-beab-b37514b703bc'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:53.142190 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] The token cache is being invalidate because project 060887fb0a984f3f9599cc1a252a9688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:51:53.142481 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:53.143129 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:51:53.144697 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1461/2896] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:51:53 2022] DELETE /identity/v3/projects/060887fb0a984f3f9599cc1a252a9688 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 14:51:57.291580 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5243db-d5f0-4ab2-b952-d1a9a72456de None None] REQUEST_METHOD: `POST` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:57.292145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5243db-d5f0-4ab2-b952-d1a9a72456de None None] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:57.292145 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5243db-d5f0-4ab2-b952-d1a9a72456de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:57.310720 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.auth.core [None req-7d5243db-d5f0-4ab2-b952-d1a9a72456de None None] MFA Rules not processed for user `d9d908e34eee4ec195fa8ce65957cba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80476) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 14:51:57.311929 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7d5243db-d5f0-4ab2-b952-d1a9a72456de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:57.372849 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1436/2897] 10.222.0.81 () {58 vars in 1016 bytes} [Wed May 25 14:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 14:51:57.396036 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:51:57.397438 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.fernet_utils [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:51:57.471942 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a676204-a077-4e3f-beab-b37514b703bc admin admin] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:51:57.477252 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b08ded-b2e4-477e-a7a8-9780cb6ac200 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb66b6f6b5524f3687411fa83d525acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:51:57.477928 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b08ded-b2e4-477e-a7a8-9780cb6ac200 service nova] REQUEST_METHOD: `GET` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:51:57.478237 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b08ded-b2e4-477e-a7a8-9780cb6ac200 service nova] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:51:57.478514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b08ded-b2e4-477e-a7a8-9780cb6ac200 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:51:57.487239 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b08ded-b2e4-477e-a7a8-9780cb6ac200 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:51:57.488835 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b08ded-b2e4-477e-a7a8-9780cb6ac200 service nova] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:51:57.498890 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1462/2898] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:52:07.365053 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:07.494461 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:25.505781 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5243db-d5f0-4ab2-b952-d1a9a72456de None None] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:25.507333 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-7d5243db-d5f0-4ab2-b952-d1a9a72456de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:52:25.520186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5243db-d5f0-4ab2-b952-d1a9a72456de None None] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:25.525214 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:25.526149 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:25.526436 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:25.526716 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] PATH_INFO: `/v3/users/8d0c587d01ac44b79972e49a5f0aeeee` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:25.528009 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d0c587d01ac44b79972e49a5f0aeeee)` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:25.530522 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:25.586950 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d0c587d01ac44b79972e49a5f0aeeee'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:25.587674 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d0c587d01ac44b79972e49a5f0aeeee'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:25.589093 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d0c587d01ac44b79972e49a5f0aeeee'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:25.603697 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d0c587d01ac44b79972e49a5f0aeeee'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:25.612101 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.notifications [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d0c587d01ac44b79972e49a5f0aeeee'} {{(pid=80476) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:25.629434 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1437/2899] 10.222.0.79 () {58 vars in 1223 bytes} [Wed May 25 14:52:25 2022] DELETE /identity/v3/users/8d0c587d01ac44b79972e49a5f0aeeee => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:25.824315 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b08ded-b2e4-477e-a7a8-9780cb6ac200 service nova] Authenticating user token {{(pid=80475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:52:25.835870 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b08ded-b2e4-477e-a7a8-9780cb6ac200 service nova] Validating token access rules against request {{(pid=80475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:52:25.900592 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9d908e34eee4ec195fa8ce65957cba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9c7281911bf46ffacaa598981eac3c1', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:52:25.901462 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:52:25.901750 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:52:25.902029 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] PATH_INFO: `/v3/projects/6caddc6b48ad479b922f4eef9841ce0f` {{(pid=80475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:52:25.903855 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6caddc6b48ad479b922f4eef9841ce0f)` {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:52:25.905812 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] RBAC: Authorization granted {{(pid=80475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:52:25.954092 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6caddc6b48ad479b922f4eef9841ce0f', 'request_id': 'req-256219fc-fb5b-44cb-b1dc-3be589850f94'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:25.965377 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6caddc6b48ad479b922f4eef9841ce0f', 'request_id': 'req-256219fc-fb5b-44cb-b1dc-3be589850f94'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:25.974303 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6caddc6b48ad479b922f4eef9841ce0f', 'request_id': 'req-256219fc-fb5b-44cb-b1dc-3be589850f94'} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:25.988081 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] The token cache is being invalidate because project 6caddc6b48ad479b922f4eef9841ce0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 14:52:25.988514 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:25.989182 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG keystone.notifications [None req-256219fc-fb5b-44cb-b1dc-3be589850f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 14:52:25.990781 dv-cinder-830283-3-smb devstack@keystone.service[80475]: [pid: 80475|app: 0|req: 1463/2900] 10.222.0.79 () {58 vars in 1232 bytes} [Wed May 25 14:52:25 2022] DELETE /identity/v3/projects/6caddc6b48ad479b922f4eef9841ce0f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 14:52:35.624057 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:52:35.984774 dv-cinder-830283-3-smb devstack@keystone.service[80475]: DEBUG dbcounter [-] [80475] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 14:56:51.695055 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] Authenticating user token {{(pid=80476) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 14:56:51.696486 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:51.835372 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb5e3c7-1381-4025-a208-add29056d0ce admin admin] Validating token access rules against request {{(pid=80476) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 14:56:51.897765 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ab2c6-4318-4fc3-a9e2-e9166254a27e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '582296b1e43f4d12ab99eec9283b0d39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a1e35ef16bc44919112de05be568ff7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80476) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 14:56:51.898457 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ab2c6-4318-4fc3-a9e2-e9166254a27e service placement] REQUEST_METHOD: `GET` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 14:56:51.898743 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ab2c6-4318-4fc3-a9e2-e9166254a27e service placement] SCRIPT_NAME: `/identity` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 14:56:51.899021 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ab2c6-4318-4fc3-a9e2-e9166254a27e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80476) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 14:56:51.900806 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.fernet_utils [None req-ce9ab2c6-4318-4fc3-a9e2-e9166254a27e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80476) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 14:56:51.911860 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ab2c6-4318-4fc3-a9e2-e9166254a27e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 14:56:51.913441 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ab2c6-4318-4fc3-a9e2-e9166254a27e service placement] RBAC: Authorization granted {{(pid=80476) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 14:56:51.923186 dv-cinder-830283-3-smb devstack@keystone.service[80476]: [pid: 80476|app: 0|req: 1438/2901] 10.222.0.79 () {60 vars in 1365 bytes} [Wed May 25 14:56:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 14:57:01.919001 dv-cinder-830283-3-smb devstack@keystone.service[80476]: DEBUG dbcounter [-] [80476] Writing DB stats keystone:SELECT=89 {{(pid=80476) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}